-- Logs begin at Fri 2022-02-04 17:03:07 UTC, end at Fri 2022-02-04 18:26:18 UTC. -- Feb 04 17:52:02.640520 dv-cinder-822768-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 04 17:52:02.649702 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 04 17:52:02.651702 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Feb 4 17:52:02 2022] *** Feb 04 17:52:02.651702 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 04 17:52:02.651702 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 04 17:52:02.651702 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: nodename: dv-cinder-822768-3-iscsi Feb 04 17:52:02.651702 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: machine: x86_64 Feb 04 17:52:02.651702 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: clock source: unix Feb 04 17:52:02.651702 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: pcre jit disabled Feb 04 17:52:02.651702 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: detected number of CPU cores: 4 Feb 04 17:52:02.651702 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: current working directory: / Feb 04 17:52:02.651702 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: detected binary path: /usr/bin/uwsgi-core Feb 04 17:52:02.651702 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: your processes number limit is 47680 Feb 04 17:52:02.652429 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: your memory page size is 4096 bytes Feb 04 17:52:02.652429 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: detected max file descriptor number: 2048 Feb 04 17:52:02.652429 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: lock engine: pthread robust mutexes Feb 04 17:52:02.652429 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: thunder lock: enabled Feb 04 17:52:02.652429 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 04 17:52:02.652429 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 04 17:52:02.696646 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: Python main interpreter initialized at 0x55e8769399c0 Feb 04 17:52:02.696646 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: python threads support enabled Feb 04 17:52:02.696646 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: your server socket listen backlog is limited to 100 connections Feb 04 17:52:02.696646 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: your mercy for graceful operations on workers is 90 seconds Feb 04 17:52:02.697022 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: mapped 403077 bytes (393 KB) for 2 cores Feb 04 17:52:02.697097 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: *** Operational MODE: preforking *** Feb 04 17:52:02.697307 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: *** uWSGI is running in multiple interpreter mode *** Feb 04 17:52:02.697307 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: spawned uWSGI master process (pid: 108669) Feb 04 17:52:02.697524 dv-cinder-822768-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 04 17:52:02.698187 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: spawned uWSGI worker 1 (pid: 108670, cores: 1) Feb 04 17:52:02.698187 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: spawned uWSGI worker 2 (pid: 108671, cores: 1) Feb 04 17:52:02.698187 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 04 17:52:04.471259 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 04 17:52:04.471259 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: from cryptography.utils import int_from_bytes Feb 04 17:52:04.471884 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 04 17:52:04.471884 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: from cryptography.utils import int_from_bytes Feb 04 17:52:04.472914 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 04 17:52:04.472914 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: from cryptography.utils import int_from_bytes Feb 04 17:52:04.473391 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 04 17:52:04.473391 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: from cryptography.utils import int_from_bytes Feb 04 17:52:07.056512 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 04 17:52:07.057099 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 04 17:52:07.057245 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 04 17:52:07.057603 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 04 17:52:07.057732 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 04 17:52:07.058087 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 04 17:52:07.058180 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 04 17:52:07.058267 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.058519 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 04 17:52:07.058618 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.058867 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.058968 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 04 17:52:07.059128 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 04 17:52:07.059225 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.059492 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.059580 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.059800 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.059884 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.060118 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.060225 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.060435 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.060538 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.060757 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.060852 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.061014 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.061099 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.061330 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.061416 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.061648 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822768-3-iscsi {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.061824 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.061965 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.062058 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.062237 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.062328 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.062582 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.062689 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.062895 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.062980 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822768-3-iscsi {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.063196 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.063282 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.063513 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.063606 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.063822 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.063907 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.064135 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.064311 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.064442 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.065606 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.065813 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.065977 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.066165 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.066455 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.067184 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.067387 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.067547 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.067761 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.067957 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.068154 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.068304 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.068500 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.068721 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.068873 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.069053 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.069268 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.069464 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.069648 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.069808 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.070030 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822768-3-iscsi {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.070236 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.070443 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.070600 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.070779 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.070977 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.071163 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.071292 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822768-3-iscsi {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.071451 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.071586 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.071711 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.071858 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.071991 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.072123 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.072261 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.072394 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.072577 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.072577 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.072891 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.072891 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.073137 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.073266 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.073389 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.073518 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.073649 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.073773 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.073918 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.073918 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.074162 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.074288 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.074445 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.074571 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.074705 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.074829 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.074952 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.075075 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.075213 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.075345 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.075468 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.075597 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.075727 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.075852 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.075983 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.076113 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.076238 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.076360 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.076517 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.076676 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.076805 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.076928 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.077052 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.077180 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.077306 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.077438 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.077562 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.077686 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.077809 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.077934 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.078069 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.078194 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.078317 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.078471 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.078596 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.078719 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.078858 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.078990 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.079113 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.079235 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.079357 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.079493 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.079617 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.079747 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.079881 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.080005 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.080134 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.080278 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.080403 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.080527 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.080648 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.080770 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.080902 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.081034 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.081158 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.081279 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.98 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.081408 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.081532 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.98 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.081655 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.081785 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.081909 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.082030 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.082152 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.082281 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.082412 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.98 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.082600 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.082722 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.98 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.082938 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.083066 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.083189 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.083320 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.083444 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.083575 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.083699 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.083828 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.083952 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.084109 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.084237 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.084429 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.084555 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.084739 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.084874 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.085047 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.085181 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.085342 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.085467 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.085649 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.085785 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.085966 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.086093 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.086271 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.086398 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.086556 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.086695 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.086821 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.086943 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.087128 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.087265 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.087448 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.087654 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.087782 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.087912 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.088059 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.088185 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.088343 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.088483 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.088648 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.088775 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.088951 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.089076 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.089255 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.089397 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.089560 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.089695 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.089864 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.090026 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.090182 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.090317 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.090522 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.090665 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.090829 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.090959 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.091136 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.091264 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.091444 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.091569 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.091746 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.091881 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.092065 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.092201 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.092371 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.092500 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.092674 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.092802 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.092985 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.093115 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.093285 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.093382 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.093587 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.093691 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.093902 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.094022 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.094207 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.094301 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.094533 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.094636 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.094851 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.094948 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.095149 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.095243 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.095455 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.095549 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.095767 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.095867 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.096073 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.096162 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.096377 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.096462 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.096677 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.096762 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.096978 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.097064 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.097283 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.097407 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.097587 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.097761 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.097902 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.098067 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.098210 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.098359 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.121339 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.121339 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.121529 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.121529 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.121685 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.121774 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.121854 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.121931 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.122007 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.122083 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.122168 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.122253 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.122331 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.122408 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.122538 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.122616 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.122709 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.122789 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.122872 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.122955 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.123032 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.123113 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.123199 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.123278 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 17:52:07.123354 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.123436 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.123513 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.123589 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.123673 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.123750 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.123829 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.123895 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.123958 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.124028 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.124094 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.124163 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.124234 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.124303 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.124368 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.124438 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.124509 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.124573 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.124637 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.124699 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.124763 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.124834 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.124899 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.124962 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.125024 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.125087 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.125168 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.125246 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.125317 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.125317 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.125431 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.125494 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.125557 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.125637 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.125703 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.125775 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.125839 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.125903 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.125984 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.125984 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.126184 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.126253 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.126318 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.126380 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.126472 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.126555 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.126622 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.126686 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.126749 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.126749 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.126875 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.126942 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.127030 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.127102 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.127166 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.127246 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.127329 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.127402 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.127467 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.127537 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.127601 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.127664 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.127735 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.127801 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.127870 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.127940 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.128005 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.128074 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.128146 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.128212 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.128297 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.128369 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.128434 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.128509 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.128574 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.128642 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.128706 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.128769 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.128831 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.128962 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.129554 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.129620 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.129683 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.129746 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.129815 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.129887 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.129952 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.130020 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.130084 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.130152 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.130216 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.130347 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.130475 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.130601 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.130702 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.130811 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.130949 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.131039 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.131123 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.131209 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.131286 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.131362 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.131450 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.131573 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.131666 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.131756 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.131835 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.131906 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.132045 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.132128 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.132128 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.132268 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.132343 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.132418 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.132501 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.132579 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.132661 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.132737 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.132812 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.132895 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.132895 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.133040 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.133040 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.133179 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.133261 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.133345 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.133429 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.133506 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.133582 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.133657 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.133732 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.133815 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.133899 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.134032 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.134120 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.134198 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.134280 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.134365 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.134459 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.134538 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.134614 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.134701 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.134792 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.134876 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.134955 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.135037 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.135114 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.135189 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.135275 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.135365 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.135443 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.135519 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.135601 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.135678 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.135811 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.135936 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.136019 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.136102 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.136185 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.136270 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.136359 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.136437 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.136513 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.136602 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.136679 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.136763 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.136840 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.136915 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.136991 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.137071 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.137147 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.137231 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.137309 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.137392 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.137470 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.137545 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.137621 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.137956 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.138043 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.138125 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.138218 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.138318 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.138399 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.138503 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.138583 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.138659 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.138741 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.138819 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.139362 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.139506 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.139617 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.139797 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.139906 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.140011 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.140124 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.140232 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.140336 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.140448 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.140553 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.140664 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.140777 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.140884 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.140988 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.141091 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.141202 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.141320 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.141435 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.141549 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.141661 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.141767 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.141871 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.141980 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.142107 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.142220 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.142326 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.142457 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.142576 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.142695 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.142802 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.142906 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.143009 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.143119 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.143223 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.143405 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.143520 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.143631 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.143736 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.143847 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.144511 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.144618 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.144700 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.144777 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.144854 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.144930 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.145015 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.145093 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.145169 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.145298 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.145423 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.145505 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.145592 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.145679 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.145757 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.145832 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.146020 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.146238 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.146330 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.146408 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.146505 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.146582 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.146670 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.146756 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.146835 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.146916 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.146999 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.147083 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.147160 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.147243 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.147320 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.147396 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.147471 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.147548 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.147623 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.147706 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.147784 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.147866 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.147943 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.148025 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.148110 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.148188 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.148270 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.148346 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.148422 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.148498 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.148583 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.148667 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.148744 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.148820 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.148895 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.148969 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.149053 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.149268 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.149358 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.149442 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.149518 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.149602 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.149688 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.149688 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.149836 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.149913 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.150007 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.150105 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.150184 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.150289 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.150372 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.150540 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.150634 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.150722 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.150801 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.150877 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.150958 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.151041 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.151122 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.151210 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.151288 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.151369 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.151446 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.151521 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.151597 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.151681 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.151758 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.151834 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.151909 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.151985 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.152068 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.152146 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.152221 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.152296 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.152378 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.152455 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.152538 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.152616 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.152697 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.152776 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.152852 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.153006 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.153104 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.153308 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.153404 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.153610 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.153698 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.153948 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.154086 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.154260 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.154360 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.154578 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.154675 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.154892 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.154991 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.155207 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.155293 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.155513 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.155598 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.155818 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.155905 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.156127 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.156274 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.156436 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.156697 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.156813 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.157051 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.157146 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.157356 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.157599 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.157708 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.157959 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.158066 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.158268 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.158486 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.158619 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.158877 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.158992 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.159198 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.159350 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.159521 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.159773 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.159906 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.160190 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.160314 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.160505 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.160619 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.160825 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.160943 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.161396 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.161501 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.161752 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.161872 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.162074 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.162197 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.162393 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.162613 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.162743 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.163008 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.163117 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.163352 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.163466 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.163698 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.163847 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.164013 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.164218 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.164350 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.164613 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.164739 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.164932 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.165107 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.165237 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.165356 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.165543 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.165759 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.165868 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.166162 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.166484 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.166607 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.166797 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.167072 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.167242 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.167380 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.167504 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.167681 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.167880 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.167994 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.168324 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.168425 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.168624 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.168805 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.168919 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.169215 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.169329 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.169533 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.169655 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.169839 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.170035 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.170154 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.170438 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.170547 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.170746 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.170891 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.171086 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.171300 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.171409 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.171733 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.171841 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.172066 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.172176 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.172403 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.172592 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.172715 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.172979 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.173096 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.173298 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.173413 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.173601 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.173755 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.173902 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.174134 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.174250 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.174522 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.174656 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.174831 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.174971 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.175166 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.175358 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.175457 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.176247 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.176433 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.176568 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.176832 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.176944 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.177175 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.177283 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.177484 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.177647 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.177782 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.178033 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.178138 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.178384 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.178542 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.178709 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.178852 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.179008 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.179236 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.179353 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.179608 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.179715 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.179929 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.180132 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.180251 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.180518 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.180636 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.180827 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.180973 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.181129 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.181398 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.181526 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.181752 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.181859 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.182058 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.182199 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.182391 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.182670 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.182795 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.183026 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.183138 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.183334 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.183524 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.183637 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.183924 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.184039 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.184229 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.184347 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.184532 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.184710 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.184866 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.185111 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.185229 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.185479 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.185574 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.185791 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.185949 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.186090 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.186363 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.186562 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.186714 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.186831 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.187014 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.187135 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.187316 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.187516 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.187633 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.187909 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.188003 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.188207 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.188438 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.188534 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.188789 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.188917 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.189089 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.189310 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.189416 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.189695 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.189815 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.189994 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.190112 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.190296 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.190520 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.190638 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.190948 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.191057 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.191248 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.191418 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.192170 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.192329 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.192477 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.192719 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.192815 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.193093 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.193199 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.193402 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.193652 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.193766 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.194033 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.194152 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.194335 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.194496 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.194673 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.194819 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.195010 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.195232 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.195349 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.195641 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.195767 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.195943 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.196087 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.196263 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.196480 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.196654 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.196857 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.196973 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.197205 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.197350 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.197525 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.197646 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.197846 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.198013 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.198179 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.198442 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.198628 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.198838 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.198943 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.199142 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.199313 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.199453 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.199705 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.199812 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.200057 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.200154 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.200367 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.200596 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.200803 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.200974 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.201092 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.201284 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.201388 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.201586 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.201774 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.201901 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.202161 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.202276 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.202619 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.202752 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.202944 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.203070 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.203251 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.203399 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.203553 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.203765 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.203880 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.204144 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.204253 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.204449 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.204565 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.204750 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.204937 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.205196 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.205355 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.205501 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.205741 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.205837 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.206134 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.206251 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.206466 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.206610 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.206776 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.207216 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.207325 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.207590 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.207757 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.207896 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.208111 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.208334 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.208469 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.208649 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.208825 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.208961 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.209171 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.209279 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.209508 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.209602 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.209847 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.209947 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.210153 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.210247 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.210500 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.210591 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.210806 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.210910 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.211109 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.211195 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.211408 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.211495 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.211726 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.211821 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.212028 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.212114 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.212346 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.212433 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.212707 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.212959 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.213061 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.213142 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.213346 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.213434 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.213687 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.213775 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.214007 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.214100 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.214330 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.214435 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.214678 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.214808 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.214997 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.215104 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.215314 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.215400 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.215616 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.215706 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.215927 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.216013 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.216234 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.216327 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.216551 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.216637 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.216866 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.216951 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.217176 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.217271 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.217487 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.217574 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.217788 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.217875 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.218104 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.218202 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.218446 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.218536 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.218748 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.218835 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.219065 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.219169 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.219377 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.219465 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.219695 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.219782 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.220009 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.220172 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.220330 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.220418 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.220642 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.220729 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.220973 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.221097 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.221276 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.221420 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.221585 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.221743 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.221889 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.222057 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.222192 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.222382 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.222534 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.222726 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.222871 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.223056 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.223187 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.223377 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.223476 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.223691 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.223789 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.224053 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.224228 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.224355 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.224444 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.224672 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.224759 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.224972 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.225068 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.225289 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.225382 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.225597 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.225684 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.225917 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.226012 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.226235 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.226324 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.226565 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.226657 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.226875 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.226963 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.227181 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.227276 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.227483 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.227571 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.227784 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.227872 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.228087 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.228174 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.228424 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.228535 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.228726 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.228855 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.229043 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.229168 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.229369 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.229591 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.229688 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.229914 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.230016 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.230228 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.230316 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.230592 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.230683 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.230924 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.231013 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.231253 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.231341 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.231563 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.231669 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.231865 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.231952 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.232168 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.232254 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.232484 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.232573 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.232788 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.232876 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.233090 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.233190 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.233392 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.233479 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.233698 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.233787 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.233997 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.234094 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.234298 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.234401 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.234624 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.234713 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.234943 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.235040 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.235244 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.235408 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.235562 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.235736 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.235869 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.236054 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.236169 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.236379 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.236467 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.236711 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.236808 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.237022 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.237111 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.237332 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.237419 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.237647 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.237814 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.237962 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.238057 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.238812 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.238928 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.239126 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.239242 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.239439 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.239527 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.239758 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.239846 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.240076 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.240196 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.240385 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.240472 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.240693 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.240781 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.241002 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.241091 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.241312 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.241399 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.241623 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.241711 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.241934 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.242070 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.242242 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.242337 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.242578 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.242681 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.242899 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.242988 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.243209 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.243297 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.243538 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.243728 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.243853 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.244057 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.244152 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.244371 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.244459 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.244683 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.244772 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.244993 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.245120 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.245305 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.245392 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.245618 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.245705 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.245929 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.246016 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.246236 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.246325 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.246570 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.246662 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.246881 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.246998 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.247206 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.247314 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.247557 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.247653 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.247880 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.247967 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.248213 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.248309 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.248525 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.248620 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.248835 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.248923 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.249146 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.249242 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.249453 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.249538 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.249764 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.249853 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.250074 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.250162 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.250389 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.250536 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.250720 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.250808 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.251029 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.251125 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.251337 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.251434 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.251666 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.251754 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.251975 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.252064 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.252307 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.252406 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.252621 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.252716 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.252930 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.253018 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.253306 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.253540 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.253618 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.253697 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.253866 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.253982 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.254735 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.254831 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.255069 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.255165 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.255389 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.255476 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.255699 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.255790 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.256010 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.256110 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.256323 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.256422 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.256652 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.256837 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.256977 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.257157 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.257302 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.257490 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.257625 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.257854 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.257956 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.258181 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.258269 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.258522 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.258624 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.258840 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.258935 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.259167 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.259254 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.259474 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.259569 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.259778 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.259894 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.260088 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.260184 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.260396 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.260646 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.260742 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.260980 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.261067 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.261301 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.261400 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.261600 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.261706 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.261913 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.262009 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.262217 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.262311 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.262564 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.263024 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.263121 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.263369 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.263457 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.263688 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.263776 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.264010 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.264107 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.264331 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.264419 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.264644 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.264743 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.264948 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.265038 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.265267 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.265355 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.265570 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.265666 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.265873 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.265960 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.266182 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.266279 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.266510 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.266615 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.266812 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.266907 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.267113 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.267202 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.267420 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.267508 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.267727 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.267815 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.268028 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.268187 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.268419 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.268513 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.268661 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.268751 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.268983 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.269070 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.269286 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.269378 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.269609 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.269699 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.269909 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.270004 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.270219 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.270327 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.270545 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.270650 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.270848 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.270946 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.271152 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.271239 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.271452 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.271540 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.271761 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.271856 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.272060 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.272169 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.272370 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.272494 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.272672 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.272816 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.272978 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.273280 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.273367 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.273587 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.273687 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.273888 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.273975 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.274247 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.274334 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.274573 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.274675 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.274876 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.274971 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.275189 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.275276 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.275496 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.275591 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.275815 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.275902 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.276125 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.276211 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.276432 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.276521 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.276747 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.276832 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.277056 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.277143 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.277383 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.277594 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.277690 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.277924 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.278012 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.278242 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.278337 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.278601 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.278717 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.278931 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.279149 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.279236 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.279503 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.279598 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.279811 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.279898 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.280131 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.280227 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.280440 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.280528 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.280748 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.280836 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.281056 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.281151 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.281361 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.281455 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.281667 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.281762 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.281973 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.282068 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.282282 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.282375 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.282614 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.282703 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.282919 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.283007 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.283223 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.283323 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.283528 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.283617 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.283840 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.283929 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.284149 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.284244 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.284465 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.284554 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.284773 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.284862 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.285085 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.285218 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.285428 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.285560 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.285735 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.285824 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.286038 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.286124 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.286343 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.286459 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.286677 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.286765 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.286986 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.287072 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.287297 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.287395 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.287607 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.287698 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.287907 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.287992 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.288220 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.288315 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.288532 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.288619 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.288841 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.288928 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.289156 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.289253 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.289462 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.289550 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.289777 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.289864 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.290086 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.290182 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.290442 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.290533 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.290756 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.290844 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.291063 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.291152 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.291380 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.291467 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.291696 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.291795 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.292020 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.292110 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.292339 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.292433 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.292642 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.292739 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.292946 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.293035 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.293248 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.293336 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.293556 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.293829 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.293918 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.294168 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.294255 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.294517 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.294619 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.294839 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.294928 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.295149 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.295238 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.295467 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.295556 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.295773 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.295860 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.296082 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.296218 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.296398 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.296494 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.296709 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.296797 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.297016 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.297105 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.297327 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.297490 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.297637 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.297731 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.297945 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.298032 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.298253 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.298349 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.298590 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.298687 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.298897 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.298985 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.299203 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.299292 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.299512 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.299600 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.299825 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.299913 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.300124 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.300219 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.300445 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.300539 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.301271 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.301368 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.301589 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.301679 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.301902 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.301991 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.302215 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.302315 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.302553 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.302655 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.302866 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.302965 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.303176 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.303275 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.303489 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.303582 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.303810 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.303899 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.304153 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.304251 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.304472 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.304570 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.304781 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.304867 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.305103 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.305189 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.305423 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.305511 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.305746 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.305846 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.306100 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.306189 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.306411 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.306575 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.306763 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.306851 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.307084 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.307172 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.307396 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.307483 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.307705 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.307792 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.308007 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.308096 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.308250 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 04 17:52:07.308347 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.308663 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.308998 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.309330 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.309641 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.309960 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.310269 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.310608 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.310945 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.311281 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.311601 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.311929 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.312248 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.312573 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.312893 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.313220 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.313547 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.313866 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.314180 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.314540 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.314858 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.315176 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.315493 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.315810 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.316124 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.316490 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.317343 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.317677 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.317990 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.318323 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.318668 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.318994 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.319317 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.319634 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.319968 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.320283 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.320603 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.320917 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.321233 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.321554 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.321875 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.322205 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.322560 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.322897 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.323224 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.323589 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.323909 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.324258 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.324591 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.324910 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.325227 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.325534 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 17:52:07.325784 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 04 17:52:07.331587 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG oslo_db.sqlalchemy.engines [None req-ca821c72-8cc9-4914-b828-e7536a16fcc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 04 17:52:07.348507 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG oslo_db.sqlalchemy.engines [None req-c3667bd6-32bb-4259-940a-5bd1aaaf52a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 04 17:52:07.394317 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.context [None req-ca821c72-8cc9-4914-b828-e7536a16fcc2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),97b60c31-2cf9-4488-ba33-21689903d427(cell1) {{(pid=108670) load_cells /opt/stack/nova/nova/context.py:464}} Feb 04 17:52:07.398584 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG oslo_concurrency.lockutils [None req-ca821c72-8cc9-4914-b828-e7536a16fcc2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 17:52:07.400154 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG oslo_concurrency.lockutils [None req-ca821c72-8cc9-4914-b828-e7536a16fcc2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 17:52:07.400967 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG oslo_concurrency.lockutils [None req-ca821c72-8cc9-4914-b828-e7536a16fcc2 None None] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 17:52:07.402969 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG oslo_concurrency.lockutils [None req-ca821c72-8cc9-4914-b828-e7536a16fcc2 None None] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 17:52:07.412017 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.context [None req-c3667bd6-32bb-4259-940a-5bd1aaaf52a2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),97b60c31-2cf9-4488-ba33-21689903d427(cell1) {{(pid=108671) load_cells /opt/stack/nova/nova/context.py:464}} Feb 04 17:52:07.413620 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG oslo_db.sqlalchemy.engines [None req-ca821c72-8cc9-4914-b828-e7536a16fcc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 04 17:52:07.416330 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG oslo_concurrency.lockutils [None req-c3667bd6-32bb-4259-940a-5bd1aaaf52a2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 17:52:07.416918 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG oslo_db.sqlalchemy.engines [None req-ca821c72-8cc9-4914-b828-e7536a16fcc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 04 17:52:07.417966 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG oslo_concurrency.lockutils [None req-c3667bd6-32bb-4259-940a-5bd1aaaf52a2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 17:52:07.418841 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG oslo_concurrency.lockutils [None req-c3667bd6-32bb-4259-940a-5bd1aaaf52a2 None None] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 17:52:07.420797 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG oslo_concurrency.lockutils [None req-c3667bd6-32bb-4259-940a-5bd1aaaf52a2 None None] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 17:52:07.433692 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG oslo_db.sqlalchemy.engines [None req-c3667bd6-32bb-4259-940a-5bd1aaaf52a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 04 17:52:07.436699 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG oslo_db.sqlalchemy.engines [None req-c3667bd6-32bb-4259-940a-5bd1aaaf52a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 04 17:52:07.573414 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG oslo_db.sqlalchemy.engines [None req-ca821c72-8cc9-4914-b828-e7536a16fcc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 04 17:52:07.594324 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG oslo_db.sqlalchemy.engines [None req-c3667bd6-32bb-4259-940a-5bd1aaaf52a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 04 17:52:07.971452 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: WARNING keystonemiddleware.auth_token [None req-ca821c72-8cc9-4914-b828-e7536a16fcc2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 04 17:52:07.978140 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: WARNING keystonemiddleware.auth_token [None req-ca821c72-8cc9-4914-b828-e7536a16fcc2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 04 17:52:07.995039 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: WARNING keystonemiddleware.auth_token [None req-c3667bd6-32bb-4259-940a-5bd1aaaf52a2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 04 17:52:08.001653 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: WARNING keystonemiddleware.auth_token [None req-c3667bd6-32bb-4259-940a-5bd1aaaf52a2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 04 17:52:08.316550 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: WARNING keystonemiddleware.auth_token [None req-ca821c72-8cc9-4914-b828-e7536a16fcc2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 04 17:52:08.321635 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: WARNING keystonemiddleware.auth_token [None req-ca821c72-8cc9-4914-b828-e7536a16fcc2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 04 17:52:08.326965 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e8769399c0 pid: 108670 (default app) Feb 04 17:52:08.329022 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-ca821c72-8cc9-4914-b828-e7536a16fcc2 None None] Calling method '>' {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:52:08.330252 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-ca821c72-8cc9-4914-b828-e7536a16fcc2 None None] 10.222.0.98 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001725 Feb 04 17:52:08.330708 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 1/1] 10.222.0.98 () {50 vars in 788 bytes} [Fri Feb 4 17:52:08 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 17:52:08.340581 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: WARNING keystonemiddleware.auth_token [None req-c3667bd6-32bb-4259-940a-5bd1aaaf52a2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 04 17:52:08.345958 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: WARNING keystonemiddleware.auth_token [None req-c3667bd6-32bb-4259-940a-5bd1aaaf52a2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 04 17:52:08.351641 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e8769399c0 pid: 108671 (default app) Feb 04 17:53:38.505117 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-ca821c72-8cc9-4914-b828-e7536a16fcc2 None None] Calling method '>' {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:53:38.506129 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-ca821c72-8cc9-4914-b828-e7536a16fcc2 None None] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Feb 04 17:53:38.506763 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 2/2] 10.222.0.98 () {54 vars in 930 bytes} [Fri Feb 4 17:53:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 17:53:38.947977 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-f0f3891f-dd61-4664-814e-c039749e493a admin admin] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:53:38.977610 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-f0f3891f-dd61-4664-814e-c039749e493a admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.463977 Feb 04 17:53:38.978462 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 1/3] 10.222.0.98 () {60 vars in 1291 bytes} [Fri Feb 4 17:53:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 17:53:41.245559 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-ca821c72-8cc9-4914-b828-e7536a16fcc2 None None] Calling method '>' {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:53:41.246589 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-ca821c72-8cc9-4914-b828-e7536a16fcc2 None None] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Feb 04 17:53:41.247144 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 3/4] 10.222.0.98 () {54 vars in 930 bytes} [Fri Feb 4 17:53:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 17:53:41.312482 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-0de63e21-22fd-4dde-a59f-0af0b67aff4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "ram": 256, "disk": 1, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 17:53:41.331214 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 17:53:41.331214 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: warnings.warn(msg) Feb 04 17:53:41.442004 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-0de63e21-22fd-4dde-a59f-0af0b67aff4b admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.188377 Feb 04 17:53:41.442962 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 2/5] 10.222.0.98 () {64 vars in 1282 bytes} [Fri Feb 4 17:53:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 04 17:53:41.696962 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-8793c785-0872-46e2-8a39-d0d25f6f2b38 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 17:53:41.699560 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 17:53:41.699560 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: warnings.warn(msg) Feb 04 17:53:41.822850 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-8793c785-0872-46e2-8a39-d0d25f6f2b38 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.371675 Feb 04 17:53:41.836848 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 4/6] 10.222.0.98 () {64 vars in 1335 bytes} [Fri Feb 4 17:53:41 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 17:53:44.114837 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-0de63e21-22fd-4dde-a59f-0af0b67aff4b admin admin] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:53:44.115965 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-0de63e21-22fd-4dde-a59f-0af0b67aff4b admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001875 Feb 04 17:53:44.116652 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 3/7] 10.222.0.98 () {54 vars in 930 bytes} [Fri Feb 4 17:53:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 17:53:44.251134 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-9cb68d27-6959-42f1-87ff-f22c2dd34f33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 512, "id": "d1", "vcpus": 1, "disk": 5}} {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 17:53:44.271458 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 17:53:44.271458 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: warnings.warn(msg) Feb 04 17:53:44.373919 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-9cb68d27-6959-42f1-87ff-f22c2dd34f33 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.251449 Feb 04 17:53:44.375265 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 5/8] 10.222.0.98 () {64 vars in 1282 bytes} [Fri Feb 4 17:53:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 04 17:53:44.390588 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-ffd49953-58c4-41bd-b744-a1ffba6b32be admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 17:53:44.392176 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 17:53:44.392176 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: warnings.warn(msg) Feb 04 17:53:44.515493 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-ffd49953-58c4-41bd-b744-a1ffba6b32be admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.129521 Feb 04 17:53:44.516085 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 4/9] 10.222.0.98 () {64 vars in 1335 bytes} [Fri Feb 4 17:53:44 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 17:53:46.773946 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-9cb68d27-6959-42f1-87ff-f22c2dd34f33 admin admin] Calling method '>' {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:53:46.775289 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-9cb68d27-6959-42f1-87ff-f22c2dd34f33 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001788 Feb 04 17:53:46.776033 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 6/10] 10.222.0.98 () {54 vars in 930 bytes} [Fri Feb 4 17:53:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 17:53:46.835803 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-ca1c7079-14ae-48e8-8989-0daca08c2676 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 1024, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G", "id": "d2", "vcpus": 1, "disk": 10}} {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 17:53:46.916615 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-ca1c7079-14ae-48e8-8989-0daca08c2676 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.134294 Feb 04 17:53:46.917163 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 5/11] 10.222.0.98 () {64 vars in 1282 bytes} [Fri Feb 4 17:53:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 04 17:53:46.929696 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-6336be2f-44f0-4d3c-8e8f-78d07cfdac6f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 17:53:47.028687 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-6336be2f-44f0-4d3c-8e8f-78d07cfdac6f admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102159 Feb 04 17:53:47.034714 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 7/12] 10.222.0.98 () {64 vars in 1335 bytes} [Fri Feb 4 17:53:46 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 17:53:49.305946 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-ca1c7079-14ae-48e8-8989-0daca08c2676 admin admin] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:53:49.307580 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-ca1c7079-14ae-48e8-8989-0daca08c2676 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002075 Feb 04 17:53:49.308325 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 6/13] 10.222.0.98 () {54 vars in 930 bytes} [Fri Feb 4 17:53:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 17:53:49.379880 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-40c09fcf-bf2d-47cd-a742-673fa3d70887 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "swap": 0, "vcpus": 2, "ram": 2048, "id": "d3", "os-flavor-access:is_public": true, "name": "ds2G"}} {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 17:53:49.476037 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-40c09fcf-bf2d-47cd-a742-673fa3d70887 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.159986 Feb 04 17:53:49.476638 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 8/14] 10.222.0.98 () {64 vars in 1282 bytes} [Fri Feb 4 17:53:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 04 17:53:49.489897 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-1c2cbc8b-1035-43da-b7a6-8771119593fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 17:53:49.582496 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-1c2cbc8b-1035-43da-b7a6-8771119593fa admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097584 Feb 04 17:53:49.583087 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 7/15] 10.222.0.98 () {64 vars in 1335 bytes} [Fri Feb 4 17:53:49 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 17:53:51.856334 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-40c09fcf-bf2d-47cd-a742-673fa3d70887 admin admin] Calling method '>' {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:53:51.857341 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-40c09fcf-bf2d-47cd-a742-673fa3d70887 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Feb 04 17:53:51.858519 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 9/16] 10.222.0.98 () {54 vars in 930 bytes} [Fri Feb 4 17:53:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 17:53:51.918280 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-338c6025-ae7e-425c-bd14-eb2d75c03b33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "rxtx_factor": 1.0, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4}} {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 17:53:51.984558 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-338c6025-ae7e-425c-bd14-eb2d75c03b33 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.120404 Feb 04 17:53:51.985369 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 8/17] 10.222.0.98 () {64 vars in 1282 bytes} [Fri Feb 4 17:53:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 04 17:53:52.000620 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-42b57aff-d755-4a26-9e06-8f45fc625f53 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 17:53:52.085998 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-42b57aff-d755-4a26-9e06-8f45fc625f53 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089950 Feb 04 17:53:52.086593 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 10/18] 10.222.0.98 () {64 vars in 1335 bytes} [Fri Feb 4 17:53:51 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 17:53:54.389361 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-338c6025-ae7e-425c-bd14-eb2d75c03b33 admin admin] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:53:54.391005 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-338c6025-ae7e-425c-bd14-eb2d75c03b33 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002119 Feb 04 17:53:54.401889 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 9/19] 10.222.0.98 () {54 vars in 930 bytes} [Fri Feb 4 17:53:54 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 17:53:54.458390 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-445d0ce4-9eee-4150-8fdb-e5d73fb4bafe admin admin] Calling method '>' {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:53:54.488241 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-445d0ce4-9eee-4150-8fdb-e5d73fb4bafe admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.090602 Feb 04 17:53:54.490871 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 11/20] 10.222.0.98 () {60 vars in 1291 bytes} [Fri Feb 4 17:53:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 17:53:57.090517 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-338c6025-ae7e-425c-bd14-eb2d75c03b33 admin admin] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:53:57.091525 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-338c6025-ae7e-425c-bd14-eb2d75c03b33 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Feb 04 17:53:57.091931 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 10/21] 10.222.0.98 () {54 vars in 930 bytes} [Fri Feb 4 17:53:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 17:53:57.155197 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-7f31e7a7-2c5b-4de2-aa45-a360ce6c5bae admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "1", "disk": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 17:53:57.232514 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-7f31e7a7-2c5b-4de2-aa45-a360ce6c5bae admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.133532 Feb 04 17:53:57.233202 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 12/22] 10.222.0.98 () {64 vars in 1282 bytes} [Fri Feb 4 17:53:57 2022] POST /compute/v2.1/flavors => generated 402 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 04 17:53:57.247522 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-66468013-469b-452d-bbb0-2b690701f090 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 17:53:57.332765 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-66468013-469b-452d-bbb0-2b690701f090 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089481 Feb 04 17:53:57.333726 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 11/23] 10.222.0.98 () {64 vars in 1332 bytes} [Fri Feb 4 17:53:57 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 17:53:59.931107 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-7f31e7a7-2c5b-4de2-aa45-a360ce6c5bae admin admin] Calling method '>' {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:53:59.932118 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-7f31e7a7-2c5b-4de2-aa45-a360ce6c5bae admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Feb 04 17:53:59.932525 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 13/24] 10.222.0.98 () {54 vars in 930 bytes} [Fri Feb 4 17:53:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 17:53:59.995512 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-ee45c936-d47a-4266-adf7-a0e3224d9db9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "disk": 20, "vcpus": 1, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.small"}} {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 17:54:00.072518 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-ee45c936-d47a-4266-adf7-a0e3224d9db9 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.133771 Feb 04 17:54:00.073177 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 12/25] 10.222.0.98 () {64 vars in 1282 bytes} [Fri Feb 4 17:53:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 04 17:54:00.087497 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-b4d3ace4-5594-43ed-bcd3-9525b05adaba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 17:54:00.167141 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-b4d3ace4-5594-43ed-bcd3-9525b05adaba admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083765 Feb 04 17:54:00.167884 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 14/26] 10.222.0.98 () {64 vars in 1332 bytes} [Fri Feb 4 17:54:00 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 17:54:02.625442 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-ee45c936-d47a-4266-adf7-a0e3224d9db9 admin admin] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:54:02.626996 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-ee45c936-d47a-4266-adf7-a0e3224d9db9 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Feb 04 17:54:02.627398 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 13/27] 10.222.0.98 () {54 vars in 930 bytes} [Fri Feb 4 17:54:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 17:54:02.686397 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-2bdf8d36-2f07-4201-86b9-f6addf11cdc2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "rxtx_factor": 1.0, "id": "3", "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 17:54:02.816857 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-2bdf8d36-2f07-4201-86b9-f6addf11cdc2 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.179619 Feb 04 17:54:02.816857 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 15/28] 10.222.0.98 () {64 vars in 1282 bytes} [Fri Feb 4 17:54:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 04 17:54:02.826713 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-8f418a00-00c0-4d11-a6bc-826960e1170f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 17:54:02.901414 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-8f418a00-00c0-4d11-a6bc-826960e1170f admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078263 Feb 04 17:54:02.902030 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 14/29] 10.222.0.98 () {64 vars in 1332 bytes} [Fri Feb 4 17:54:02 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 17:54:05.251909 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-2bdf8d36-2f07-4201-86b9-f6addf11cdc2 admin admin] Calling method '>' {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:54:05.253582 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-2bdf8d36-2f07-4201-86b9-f6addf11cdc2 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002171 Feb 04 17:54:05.254168 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 16/30] 10.222.0.98 () {54 vars in 930 bytes} [Fri Feb 4 17:54:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 17:54:05.325092 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-97e05236-a6e9-4c53-9542-f0f88bff1bfe admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "name": "m1.large", "ram": 8192, "rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "4"}} {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 17:54:05.560633 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-97e05236-a6e9-4c53-9542-f0f88bff1bfe admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.299883 Feb 04 17:54:05.561185 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 15/31] 10.222.0.98 () {64 vars in 1282 bytes} [Fri Feb 4 17:54:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 04 17:54:05.573330 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-ecbdfdfa-1002-4207-bddb-9877aef25ccd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 17:54:05.650586 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-ecbdfdfa-1002-4207-bddb-9877aef25ccd admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080889 Feb 04 17:54:05.651251 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 17/32] 10.222.0.98 () {64 vars in 1332 bytes} [Fri Feb 4 17:54:05 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 17:54:07.915986 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-97e05236-a6e9-4c53-9542-f0f88bff1bfe admin admin] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:54:07.917012 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-97e05236-a6e9-4c53-9542-f0f88bff1bfe admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Feb 04 17:54:07.917417 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 16/33] 10.222.0.98 () {54 vars in 930 bytes} [Fri Feb 4 17:54:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 17:54:07.983264 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-2309f98d-6a20-4937-9a6c-37299d701462 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "id": "5", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 16384, "disk": 160, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 17:54:08.069838 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-2309f98d-6a20-4937-9a6c-37299d701462 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.146366 Feb 04 17:54:08.070654 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 18/34] 10.222.0.98 () {64 vars in 1282 bytes} [Fri Feb 4 17:54:07 2022] POST /compute/v2.1/flavors => generated 408 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 04 17:54:08.082299 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-cd96d0ab-a83b-47f9-8c57-040f0cbcd515 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 17:54:08.181921 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-cd96d0ab-a83b-47f9-8c57-040f0cbcd515 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103301 Feb 04 17:54:08.182515 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 17/35] 10.222.0.98 () {64 vars in 1332 bytes} [Fri Feb 4 17:54:08 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 17:54:31.199609 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-2309f98d-6a20-4937-9a6c-37299d701462 admin admin] Calling method '>' {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:54:31.200618 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-2309f98d-6a20-4937-9a6c-37299d701462 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Feb 04 17:54:31.201016 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 19/36] 10.222.0.98 () {54 vars in 930 bytes} [Fri Feb 4 17:54:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 17:54:31.258220 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-0b4d428e-49a2-4792-9794-570f2c6b65f4 admin admin] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:54:31.275398 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-0b4d428e-49a2-4792-9794-570f2c6b65f4 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067793 Feb 04 17:54:31.275930 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 18/37] 10.222.0.98 () {60 vars in 1291 bytes} [Fri Feb 4 17:54:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 17:54:32.647908 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-2309f98d-6a20-4937-9a6c-37299d701462 admin admin] Calling method '>' {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:54:32.648915 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-2309f98d-6a20-4937-9a6c-37299d701462 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Feb 04 17:54:32.649345 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 20/38] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Feb 4 17:54:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 17:54:32.860710 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-5d576510-366c-48f6-846e-806f45e4d64a admin admin] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:54:32.866151 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.wsgi [None req-5d576510-366c-48f6-846e-806f45e4d64a admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 04 17:54:32.866761 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-5d576510-366c-48f6-846e-806f45e4d64a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 17:54:32.867562 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-5d576510-366c-48f6-846e-806f45e4d64a admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057541 Feb 04 17:54:32.868062 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 19/39] 10.222.0.98 () {60 vars in 1190 bytes} [Fri Feb 4 17:54:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 04 17:54:32.877173 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-21c7222f-8c2f-404e-a968-54b6473d70d4 admin admin] Calling method '>' {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:54:32.897920 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-21c7222f-8c2f-404e-a968-54b6473d70d4 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024220 Feb 04 17:54:32.898452 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 21/40] 10.222.0.98 () {60 vars in 1210 bytes} [Fri Feb 4 17:54:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 17:54:32.908380 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-a4354a4e-f896-4750-b085-513a2184e62f admin admin] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:54:32.928967 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-a4354a4e-f896-4750-b085-513a2184e62f admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024626 Feb 04 17:54:32.929501 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 20/41] 10.222.0.98 () {60 vars in 1210 bytes} [Fri Feb 4 17:54:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 17:54:32.938705 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-0bb4237d-c126-4432-82b3-5406943a07b5 admin admin] Calling method '>' {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:54:32.943989 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.wsgi [None req-0bb4237d-c126-4432-82b3-5406943a07b5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 04 17:54:32.944543 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-0bb4237d-c126-4432-82b3-5406943a07b5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 17:54:32.945315 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-0bb4237d-c126-4432-82b3-5406943a07b5 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010181 Feb 04 17:54:32.945798 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 22/42] 10.222.0.98 () {60 vars in 1190 bytes} [Fri Feb 4 17:54:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Feb 04 17:54:34.223814 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-a4354a4e-f896-4750-b085-513a2184e62f admin admin] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:54:34.224810 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-a4354a4e-f896-4750-b085-513a2184e62f admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Feb 04 17:54:34.225200 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 21/43] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Feb 4 17:54:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 17:54:34.417789 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-112e59ec-4cfd-43e5-b293-a1da46550605 admin admin] Calling method '>' {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:54:34.423014 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.wsgi [None req-112e59ec-4cfd-43e5-b293-a1da46550605 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 04 17:54:34.426355 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-112e59ec-4cfd-43e5-b293-a1da46550605 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 17:54:34.426355 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-112e59ec-4cfd-43e5-b293-a1da46550605 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058172 Feb 04 17:54:34.426355 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 23/44] 10.222.0.98 () {60 vars in 1190 bytes} [Fri Feb 4 17:54:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 04 17:54:34.434054 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-066a52d4-13e4-4ba9-85c7-e20e38292f7f admin admin] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:54:34.448093 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-066a52d4-13e4-4ba9-85c7-e20e38292f7f admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017540 Feb 04 17:54:34.448624 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 22/45] 10.222.0.98 () {60 vars in 1210 bytes} [Fri Feb 4 17:54:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 17:54:34.458505 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-88f7a756-494b-4e28-80b8-254ec47074b0 admin admin] Calling method '>' {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:54:34.473091 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-88f7a756-494b-4e28-80b8-254ec47074b0 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018044 Feb 04 17:54:34.473615 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 24/46] 10.222.0.98 () {60 vars in 1210 bytes} [Fri Feb 4 17:54:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 17:54:34.483019 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-ff01b16a-6595-4322-9f49-d1230fd010c0 admin admin] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:54:34.488248 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.wsgi [None req-ff01b16a-6595-4322-9f49-d1230fd010c0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 04 17:54:34.488816 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-ff01b16a-6595-4322-9f49-d1230fd010c0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 17:54:34.489583 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-ff01b16a-6595-4322-9f49-d1230fd010c0 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010025 Feb 04 17:54:34.490066 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 23/47] 10.222.0.98 () {60 vars in 1190 bytes} [Fri Feb 4 17:54:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 04 17:54:35.738869 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-88f7a756-494b-4e28-80b8-254ec47074b0 admin admin] Calling method '>' {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:54:35.740803 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-88f7a756-494b-4e28-80b8-254ec47074b0 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Feb 04 17:54:35.740803 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 25/48] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Feb 4 17:54:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 17:54:35.932337 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-d7cb2285-83fb-4d4b-bc37-47a508e1fa7f admin admin] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:54:35.937474 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.wsgi [None req-d7cb2285-83fb-4d4b-bc37-47a508e1fa7f admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 04 17:54:35.938657 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-d7cb2285-83fb-4d4b-bc37-47a508e1fa7f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 17:54:35.939456 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-d7cb2285-83fb-4d4b-bc37-47a508e1fa7f admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057143 Feb 04 17:54:35.939949 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 24/49] 10.222.0.98 () {60 vars in 1193 bytes} [Fri Feb 4 17:54:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Feb 04 17:54:35.949203 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-1051843f-915b-4bdc-9a3b-5982282a2c85 admin admin] Calling method '>' {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:54:35.962854 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-1051843f-915b-4bdc-9a3b-5982282a2c85 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017228 Feb 04 17:54:35.963366 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 26/50] 10.222.0.98 () {60 vars in 1210 bytes} [Fri Feb 4 17:54:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 17:54:35.973842 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-efdb9c92-07d1-4ebb-ac68-67754f2e3411 admin admin] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:54:35.987249 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-efdb9c92-07d1-4ebb-ac68-67754f2e3411 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018215 Feb 04 17:54:35.987769 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 25/51] 10.222.0.98 () {60 vars in 1210 bytes} [Fri Feb 4 17:54:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 17:54:35.996768 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-d145549c-c433-407e-bcff-7f5dbdeb5f41 admin admin] Calling method '>' {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:54:36.001998 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.wsgi [None req-d145549c-c433-407e-bcff-7f5dbdeb5f41 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 04 17:54:36.002596 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-d145549c-c433-407e-bcff-7f5dbdeb5f41 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 17:54:36.003388 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-d145549c-c433-407e-bcff-7f5dbdeb5f41 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010105 Feb 04 17:54:36.003873 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 27/52] 10.222.0.98 () {60 vars in 1193 bytes} [Fri Feb 4 17:54:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 04 17:54:37.269172 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-efdb9c92-07d1-4ebb-ac68-67754f2e3411 admin admin] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:54:37.270177 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-efdb9c92-07d1-4ebb-ac68-67754f2e3411 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Feb 04 17:54:37.270602 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 26/53] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Feb 4 17:54:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 17:54:37.461657 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-31f0d669-b1a6-4a44-90c3-6d23543d4723 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 17:54:37.547623 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-31f0d669-b1a6-4a44-90c3-6d23543d4723 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.136867 Feb 04 17:54:37.548162 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 28/54] 10.222.0.98 () {64 vars in 1235 bytes} [Fri Feb 4 17:54:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 04 17:54:38.819813 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-efdb9c92-07d1-4ebb-ac68-67754f2e3411 admin admin] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:54:38.819813 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-efdb9c92-07d1-4ebb-ac68-67754f2e3411 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Feb 04 17:54:38.819813 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 27/55] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Feb 4 17:54:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 17:54:39.010826 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-2e1744a0-2c12-4620-b751-d3a0cb1cf235 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 17:54:39.085292 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-2e1744a0-2c12-4620-b751-d3a0cb1cf235 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.128613 Feb 04 17:54:39.085755 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 29/56] 10.222.0.98 () {64 vars in 1235 bytes} [Fri Feb 4 17:54:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 04 17:54:40.351823 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-efdb9c92-07d1-4ebb-ac68-67754f2e3411 admin admin] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:54:40.352819 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-efdb9c92-07d1-4ebb-ac68-67754f2e3411 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Feb 04 17:54:40.353205 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 28/57] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Feb 4 17:54:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 17:54:40.544953 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-02ba757d-3fa6-437c-95d8-67c2a7552340 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 17:54:40.646035 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-02ba757d-3fa6-437c-95d8-67c2a7552340 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.152063 Feb 04 17:54:40.646593 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 30/58] 10.222.0.98 () {64 vars in 1235 bytes} [Fri Feb 4 17:54:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 04 17:54:41.898137 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-efdb9c92-07d1-4ebb-ac68-67754f2e3411 admin admin] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:54:41.899198 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-efdb9c92-07d1-4ebb-ac68-67754f2e3411 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Feb 04 17:54:41.899590 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 29/59] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Feb 4 17:54:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 17:54:42.086789 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-8207a7da-9c9a-4440-9fd3-0373f41ff8b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 17:54:42.210652 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-8207a7da-9c9a-4440-9fd3-0373f41ff8b9 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.173818 Feb 04 17:54:42.211207 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 31/60] 10.222.0.98 () {64 vars in 1235 bytes} [Fri Feb 4 17:54:42 2022] POST /compute/v2.1/flavors => generated 409 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 04 17:54:43.470788 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-efdb9c92-07d1-4ebb-ac68-67754f2e3411 admin admin] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:54:43.471824 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-efdb9c92-07d1-4ebb-ac68-67754f2e3411 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Feb 04 17:54:43.472227 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 30/61] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Feb 4 17:54:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 17:54:43.660844 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-a60c501d-e866-45b9-9fc0-deeb8353a2c1 admin admin] Calling method '>' {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:54:43.679445 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-a60c501d-e866-45b9-9fc0-deeb8353a2c1 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069210 Feb 04 17:54:43.680013 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 32/62] 10.222.0.98 () {60 vars in 1202 bytes} [Fri Feb 4 17:54:43 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 17:55:29.741054 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-efdb9c92-07d1-4ebb-ac68-67754f2e3411 admin admin] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:55:29.742062 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-efdb9c92-07d1-4ebb-ac68-67754f2e3411 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Feb 04 17:55:29.742487 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 31/63] 10.222.0.98 () {54 vars in 930 bytes} [Fri Feb 4 17:55:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 17:55:29.800440 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-0acd62d7-7eb7-4893-a785-9901c7fbb3f2 admin admin] Calling method '>' {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:55:29.820847 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-0acd62d7-7eb7-4893-a785-9901c7fbb3f2 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072427 Feb 04 17:55:29.821384 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 33/64] 10.222.0.98 () {60 vars in 1291 bytes} [Fri Feb 4 17:55:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 17:55:29.843877 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-9beafa7a-8bd6-47cc-a2d4-a370e84ea32b admin admin] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:55:29.851730 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-9beafa7a-8bd6-47cc-a2d4-a370e84ea32b admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011513 Feb 04 17:55:29.852272 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 32/65] 10.222.0.98 () {60 vars in 1282 bytes} [Fri Feb 4 17:55:29 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 17:55:29.863748 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-551fbb25-657c-4c9f-9b8f-7bad502fce78 admin admin] Calling method '>' {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:55:29.871634 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-551fbb25-657c-4c9f-9b8f-7bad502fce78 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011394 Feb 04 17:55:29.872184 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 34/66] 10.222.0.98 () {60 vars in 1285 bytes} [Fri Feb 4 17:55:29 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 17:55:29.884435 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-93659bce-1a54-4f68-a0f7-e6867a845b72 admin admin] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:55:29.892764 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-93659bce-1a54-4f68-a0f7-e6867a845b72 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012122 Feb 04 17:55:29.893302 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 33/67] 10.222.0.98 () {60 vars in 1285 bytes} [Fri Feb 4 17:55:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 17:55:29.904658 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-5407812d-205a-43da-bf1c-3d7dde7d313e admin admin] Calling method '>' {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:55:29.913845 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-5407812d-205a-43da-bf1c-3d7dde7d313e admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011227 Feb 04 17:55:29.913845 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 35/68] 10.222.0.98 () {60 vars in 1282 bytes} [Fri Feb 4 17:55:29 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 17:57:09.540351 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-c5a175fa-72a6-45d9-87d5-17f4864cf3c3 tempest-verify_tempest_config-653885597 tempest-verify_tempest_config-653885597-project] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:57:09.543037 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-c5a175fa-72a6-45d9-87d5-17f4864cf3c3 tempest-verify_tempest_config-653885597 tempest-verify_tempest_config-653885597-project] 10.222.0.98 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.107422 Feb 04 17:57:09.543570 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 34/69] 10.222.0.98 () {58 vars in 1133 bytes} [Fri Feb 4 17:57:09 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 04 17:58:41.847897 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-5407812d-205a-43da-bf1c-3d7dde7d313e admin admin] Calling method '>' {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:58:41.848893 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-5407812d-205a-43da-bf1c-3d7dde7d313e admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Feb 04 17:58:41.849273 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 36/70] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Feb 4 17:58:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 17:58:42.101653 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-8fa6fbdc-59c2-4233-93e0-db12d4f9eee7 admin admin] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:58:42.103563 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 17:58:42.103563 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: warnings.warn(msg) Feb 04 17:58:42.105119 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG oslo_concurrency.lockutils [None req-8fa6fbdc-59c2-4233-93e0-db12d4f9eee7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 17:58:42.105559 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG oslo_concurrency.lockutils [None req-8fa6fbdc-59c2-4233-93e0-db12d4f9eee7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 17:58:42.106397 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG oslo_concurrency.lockutils [None req-8fa6fbdc-59c2-4233-93e0-db12d4f9eee7 admin admin] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 17:58:42.106830 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG oslo_concurrency.lockutils [None req-8fa6fbdc-59c2-4233-93e0-db12d4f9eee7 admin admin] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 17:58:42.140473 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-8fa6fbdc-59c2-4233-93e0-db12d4f9eee7 admin admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.149418 Feb 04 17:58:42.141034 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 35/71] 10.222.0.98 () {60 vars in 1193 bytes} [Fri Feb 4 17:58:41 2022] GET /compute/v2.1/os-services => generated 791 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 04 17:58:43.406993 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-5407812d-205a-43da-bf1c-3d7dde7d313e admin admin] Calling method '>' {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:58:43.407985 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-5407812d-205a-43da-bf1c-3d7dde7d313e admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Feb 04 17:58:43.408376 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 37/72] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Feb 4 17:58:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 17:58:43.599307 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-504eee97-a4ad-4907-a99e-f4d3bc9ee74a admin admin] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:58:43.600465 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 17:58:43.600465 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: warnings.warn(msg) Feb 04 17:58:43.601992 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG oslo_concurrency.lockutils [None req-504eee97-a4ad-4907-a99e-f4d3bc9ee74a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 17:58:43.602501 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG oslo_concurrency.lockutils [None req-504eee97-a4ad-4907-a99e-f4d3bc9ee74a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 17:58:43.603970 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG oslo_concurrency.lockutils [None req-504eee97-a4ad-4907-a99e-f4d3bc9ee74a admin admin] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 17:58:43.604406 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG oslo_concurrency.lockutils [None req-504eee97-a4ad-4907-a99e-f4d3bc9ee74a admin admin] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 17:58:43.623070 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-504eee97-a4ad-4907-a99e-f4d3bc9ee74a admin admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074009 Feb 04 17:58:43.623628 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 36/73] 10.222.0.98 () {60 vars in 1193 bytes} [Fri Feb 4 17:58:43 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 04 17:58:55.339723 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-5407812d-205a-43da-bf1c-3d7dde7d313e admin admin] Calling method '>' {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:58:55.340725 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-5407812d-205a-43da-bf1c-3d7dde7d313e admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Feb 04 17:58:55.341145 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 38/74] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Feb 4 17:58:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 17:58:55.536328 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-a9331408-5926-4700-96c1-df0568b4461f admin admin] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:58:55.537479 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 17:58:55.537479 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: warnings.warn(msg) Feb 04 17:58:55.539684 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG oslo_concurrency.lockutils [None req-a9331408-5926-4700-96c1-df0568b4461f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 17:58:55.540130 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG oslo_concurrency.lockutils [None req-a9331408-5926-4700-96c1-df0568b4461f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 17:58:55.540930 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG oslo_concurrency.lockutils [None req-a9331408-5926-4700-96c1-df0568b4461f admin admin] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 17:58:55.541355 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG oslo_concurrency.lockutils [None req-a9331408-5926-4700-96c1-df0568b4461f admin admin] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 17:58:55.564974 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-a9331408-5926-4700-96c1-df0568b4461f admin admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080506 Feb 04 17:58:55.565522 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 37/75] 10.222.0.98 () {60 vars in 1193 bytes} [Fri Feb 4 17:58:55 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 17:58:56.848105 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: DEBUG nova.api.openstack.wsgi [None req-5407812d-205a-43da-bf1c-3d7dde7d313e admin admin] Calling method '>' {{(pid=108670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:58:56.849145 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: INFO nova.api.openstack.requestlog [None req-5407812d-205a-43da-bf1c-3d7dde7d313e admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Feb 04 17:58:56.849543 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: [pid: 108670|app: 0|req: 39/76] 10.222.0.98 () {56 vars in 1074 bytes} [Fri Feb 4 17:58:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 17:58:57.042997 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG nova.api.openstack.wsgi [None req-c514b589-03b6-4e68-ac6a-1ecb41bba6fd admin admin] Calling method '>' {{(pid=108671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 17:58:57.044178 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 17:58:57.044178 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: warnings.warn(msg) Feb 04 17:58:57.045693 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG oslo_concurrency.lockutils [None req-c514b589-03b6-4e68-ac6a-1ecb41bba6fd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 17:58:57.046162 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG oslo_concurrency.lockutils [None req-c514b589-03b6-4e68-ac6a-1ecb41bba6fd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 17:58:57.047023 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG oslo_concurrency.lockutils [None req-c514b589-03b6-4e68-ac6a-1ecb41bba6fd admin admin] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 17:58:57.047477 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: DEBUG oslo_concurrency.lockutils [None req-c514b589-03b6-4e68-ac6a-1ecb41bba6fd admin admin] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 17:58:57.068467 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: INFO nova.api.openstack.requestlog [None req-c514b589-03b6-4e68-ac6a-1ecb41bba6fd admin admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.076366 Feb 04 17:58:57.068948 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: [pid: 108671|app: 0|req: 38/77] 10.222.0.98 () {60 vars in 1193 bytes} [Fri Feb 4 17:58:56 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 17:59:57.069160 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: Fri Feb 4 17:59:57 2022 - graceful shutdown triggered... Feb 04 17:59:57.069811 dv-cinder-822768-3-iscsi devstack@n-api.service[108670]: Gracefully killing worker 1 (pid: 108670)... Feb 04 17:59:57.070254 dv-cinder-822768-3-iscsi devstack@n-api.service[108671]: Gracefully killing worker 2 (pid: 108671)... Feb 04 17:59:57.071906 dv-cinder-822768-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 04 17:59:58.070309 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: worker 1 buried after 1 seconds Feb 04 17:59:58.070309 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: worker 2 buried after 1 seconds Feb 04 17:59:58.070309 dv-cinder-822768-3-iscsi devstack@n-api.service[108669]: goodbye to uWSGI. Feb 04 17:59:58.071891 dv-cinder-822768-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Feb 04 17:59:58.072462 dv-cinder-822768-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 04 17:59:58.075146 dv-cinder-822768-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 04 17:59:58.091076 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 04 17:59:58.093100 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Feb 4 17:59:58 2022] *** Feb 04 17:59:58.093100 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 04 17:59:58.093100 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 04 17:59:58.093100 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: nodename: dv-cinder-822768-3-iscsi Feb 04 17:59:58.093100 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: machine: x86_64 Feb 04 17:59:58.093100 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: clock source: unix Feb 04 17:59:58.093100 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: pcre jit disabled Feb 04 17:59:58.093100 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: detected number of CPU cores: 4 Feb 04 17:59:58.093100 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: current working directory: / Feb 04 17:59:58.093100 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: detected binary path: /usr/bin/uwsgi-core Feb 04 17:59:58.093869 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: your processes number limit is 47680 Feb 04 17:59:58.093869 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: your memory page size is 4096 bytes Feb 04 17:59:58.093869 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: detected max file descriptor number: 2048 Feb 04 17:59:58.093869 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: lock engine: pthread robust mutexes Feb 04 17:59:58.093869 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: thunder lock: enabled Feb 04 17:59:58.093869 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 04 17:59:58.093869 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 04 17:59:58.141071 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: Python main interpreter initialized at 0x55afab4c19c0 Feb 04 17:59:58.141071 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: python threads support enabled Feb 04 17:59:58.141071 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: your server socket listen backlog is limited to 100 connections Feb 04 17:59:58.141071 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: your mercy for graceful operations on workers is 90 seconds Feb 04 17:59:58.141473 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: mapped 403077 bytes (393 KB) for 2 cores Feb 04 17:59:58.141539 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: *** Operational MODE: preforking *** Feb 04 17:59:58.141810 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: *** uWSGI is running in multiple interpreter mode *** Feb 04 17:59:58.141810 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: spawned uWSGI master process (pid: 123548) Feb 04 17:59:58.142016 dv-cinder-822768-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 04 17:59:58.144214 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: spawned uWSGI worker 1 (pid: 123566, cores: 1) Feb 04 17:59:58.144214 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: spawned uWSGI worker 2 (pid: 123567, cores: 1) Feb 04 17:59:58.144214 dv-cinder-822768-3-iscsi devstack@n-api.service[123548]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 04 18:00:00.131049 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 04 18:00:00.131049 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: from cryptography.utils import int_from_bytes Feb 04 18:00:00.132266 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 04 18:00:00.132266 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: from cryptography.utils import int_from_bytes Feb 04 18:00:00.141944 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 04 18:00:00.141944 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: from cryptography.utils import int_from_bytes Feb 04 18:00:00.141944 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 04 18:00:00.141944 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: from cryptography.utils import int_from_bytes Feb 04 18:00:02.545621 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 04 18:00:02.546170 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 04 18:00:02.546563 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 04 18:00:02.546816 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 04 18:00:02.547079 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 04 18:00:02.547488 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.547825 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.548158 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.548486 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.548826 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.549153 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.549483 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.549814 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.550150 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.550627 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.550965 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.551300 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822768-3-iscsi {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.551821 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.552143 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.552469 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.552835 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.553158 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.553490 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.553808 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.554321 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.554792 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.555113 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.555436 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.555783 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.556108 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.556430 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.556762 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.557079 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.557415 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.557735 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.558149 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822768-3-iscsi {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.558503 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.558829 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.559154 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.559579 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.560100 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.560297 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.560639 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.561140 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.561468 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.561809 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.562141 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.562585 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.562922 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.563239 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.563561 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.563881 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.564211 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.564532 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.564846 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.565107 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.565426 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.565763 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.566092 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.566485 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.566708 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.566968 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.567298 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.567634 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.567974 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.568822 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.569142 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.569461 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.569803 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.570388 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.570827 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.571151 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.571484 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.571817 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.572233 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.572812 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.573159 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.573596 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.98 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.573859 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.98 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.574181 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.574577 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.574908 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.575231 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.575733 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.575875 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.576200 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.576522 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.577077 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.577416 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.577753 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.578071 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.578333 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.578677 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.578998 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.579328 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.579649 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.579964 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.580558 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.580824 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.581140 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.581463 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.581787 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.582105 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.582456 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.582766 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.583083 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.583409 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.583729 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.584723 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.584898 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 04 18:00:02.585307 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.585400 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 04 18:00:02.585483 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.585673 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.585754 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 04 18:00:02.585990 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.586088 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 04 18:00:02.586290 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 04 18:00:02.586371 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.586650 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.586800 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.586962 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.587121 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.587287 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.587432 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.587584 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.587738 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.587889 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.588050 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.588211 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.588371 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.588524 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.588676 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.588821 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.588964 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.589112 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.589276 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.589421 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.589564 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.589715 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.589871 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.590955 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.591128 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822768-3-iscsi {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.591277 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.591432 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.591577 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.591728 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.591923 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.592161 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.592321 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.592465 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.592609 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.592758 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.592936 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.593083 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.593236 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.594122 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.594283 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.594283 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.594627 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.594832 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.594982 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.595127 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.595278 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.595433 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.595584 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.595741 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.595889 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.596042 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.596197 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.596197 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.596486 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.596712 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.596882 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.597037 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.597193 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.597348 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.597500 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.597652 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.598232 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.598398 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822768-3-iscsi {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.598659 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.598819 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.598965 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.599111 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.599275 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.599428 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.599584 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.599584 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.599873 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.600024 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.600176 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.600339 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.600484 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.600627 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.600799 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.601131 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.601918 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.602098 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.602253 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.602407 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.602612 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.602768 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.602929 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.603075 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.603218 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.603370 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.603685 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.603927 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.604088 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.604246 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.604403 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.604556 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.604701 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.604933 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.605091 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.605091 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.605374 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.605374 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.605663 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.605819 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.605972 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.606729 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.606971 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.607133 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.607288 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.607449 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.607597 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.607741 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.607884 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.608086 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.608244 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.608400 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.608546 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.608702 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.608866 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.609012 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.609168 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.609321 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.609761 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.609916 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.610075 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.610075 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.610363 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.610582 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.610744 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.610897 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.611173 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.611497 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.611660 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.611816 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.612086 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.612246 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.612400 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.612553 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.612712 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.612866 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.613018 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.613163 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.613306 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.613547 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.613872 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.614125 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.614283 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.614283 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.614594 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.98 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.614748 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.614902 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.98 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.615046 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.615197 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.615394 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.615548 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.615713 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.615882 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.616028 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.616179 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.616323 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.616466 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.616618 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.616762 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.616905 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.617137 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.617287 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.617440 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.617585 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.617753 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.617907 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.618062 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.618218 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.618380 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.618551 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.618707 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.618852 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.618995 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.619153 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.619299 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.619711 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.619858 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.620012 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.620164 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.620318 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.620462 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.620620 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.620771 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.620914 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.621064 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.621242 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.622977 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.623144 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.623302 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.623450 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.623607 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.623786 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.624098 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.624325 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.624491 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.624652 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.624798 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.624950 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.625108 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.625261 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.625414 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.625565 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.625722 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.625891 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.626050 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.626202 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.626359 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.626581 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.626741 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.626956 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.627137 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.627137 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.627509 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.627655 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.627799 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.627957 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.628116 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.628116 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.628408 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.628563 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.628707 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.628707 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.628979 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.628979 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.629278 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.629278 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.629698 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.629698 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.629698 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.630163 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.630322 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.630497 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.630650 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.631294 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.631453 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.631608 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.631762 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.631915 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.632068 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.632213 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.632444 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.632622 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.632777 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.633130 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.633292 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.633446 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.633592 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.633746 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.633893 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.634203 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.634467 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.634634 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.634787 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.634943 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.635112 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.635265 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.635419 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.635571 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.635745 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.636007 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.636183 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.636331 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.636477 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.636627 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.636627 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.636919 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.637062 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.637218 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.637389 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.637611 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.637778 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.637933 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.638080 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 04 18:00:02.638268 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.638268 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.638578 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.638743 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.638889 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.639043 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.639199 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.639343 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.639564 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.639719 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.639864 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.640022 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.640182 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.640328 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.640328 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.640619 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.640764 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.640907 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.641051 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.641219 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.641374 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.641532 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.641678 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.641831 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.641989 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.642135 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.642293 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.642577 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.642732 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.642877 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.643057 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.643397 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.643569 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.643723 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.643876 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.644028 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.644192 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.644579 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.644846 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.645019 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.645167 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.645826 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.645989 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.646150 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.646303 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.646514 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.647245 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.647419 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.647597 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.647822 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.647975 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.647975 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.648261 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.648405 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.648600 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.648748 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.648891 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.649054 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.649207 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.649359 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.649524 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.649678 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.649835 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.649981 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.650131 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.650282 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.650459 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.650631 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.650796 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.650949 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.651118 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.651270 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.651434 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.651594 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.651750 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.651900 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.652051 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.652210 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.652360 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.652519 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.652768 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.652933 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.653085 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.653256 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.653613 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.653782 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.653935 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.654094 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.654246 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.654623 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.654852 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.655009 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.655159 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.655309 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.655468 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.655639 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.655822 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.655983 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.656143 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.656301 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.656301 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.656612 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.656612 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.656901 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.657050 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.657200 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.657363 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.657515 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.657515 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.657838 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.658062 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.658219 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.658385 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.658573 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.658735 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.658894 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.659047 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.659198 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.659362 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.659521 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.659681 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.659851 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.660004 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.660162 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.660322 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.660475 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.660626 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.660775 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.660926 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.661087 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.661239 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.661395 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.661547 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.661709 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.661872 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.662062 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.662229 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.662229 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.662572 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.662742 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.662978 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.663146 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.663305 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.663457 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.663812 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.663972 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.664130 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.664304 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.664476 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.664769 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.665013 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.665180 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.665485 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.665651 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.665821 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.665974 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.666133 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.666287 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.666470 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.666648 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.666800 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.666959 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.667111 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.667266 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.667433 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.667433 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.667744 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.668531 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.668697 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.669056 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.669232 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.669385 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.669550 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.669715 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.669868 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.670034 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.670187 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.670337 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.670517 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.670683 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.670843 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.671009 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.671160 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.671310 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.671460 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.671632 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.671784 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.671952 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.672185 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.672348 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.672348 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.672862 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.673108 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.673276 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.673276 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.673574 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.673754 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.674103 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.674278 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.674530 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.674729 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.675031 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.675273 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.675448 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.675680 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.675855 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.676009 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.676168 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.676331 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.676482 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.676645 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.676796 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.676955 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.677117 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.677269 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.677427 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.677578 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.677759 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.677913 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.678078 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.678333 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.678524 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.678680 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.678856 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.679021 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.679021 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.679375 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.679375 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.679670 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.679820 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.679972 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.680180 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.680345 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.680509 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.680669 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.680828 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.681111 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.681273 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.681434 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.681586 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.681744 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.681904 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.682067 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.682228 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.682388 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.682573 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.682727 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.682878 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.683045 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.683045 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.683462 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.683615 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.683773 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.683925 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.684305 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.684465 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.684615 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.684766 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.684934 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.685183 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.685440 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.685612 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.685859 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.686016 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.686175 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.686342 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.686560 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.686714 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.686872 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.687024 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.687174 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.687334 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.687486 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.687636 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.687798 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.687956 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.688107 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.688272 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.688272 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.688664 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.688825 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.688984 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.689143 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.689305 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.689457 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.689614 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.689772 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.689940 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.690233 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.690409 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.690586 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.690748 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.690901 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.691052 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.691212 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.691371 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.691532 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.691682 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.691839 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.692004 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.692179 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.692340 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.692502 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.692653 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.692816 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.692967 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.693140 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.693908 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.694076 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.694443 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.694622 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.694789 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.694949 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.695120 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.695379 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.695631 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.695803 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.696056 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.696222 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.696375 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.696532 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.696692 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.696851 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.697012 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.697173 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.697337 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.697488 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.697647 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.697807 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.697972 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.698132 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.698132 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.698449 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.698697 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.698866 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.699019 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.699176 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.699335 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.699504 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.699668 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.699831 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.699992 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.700151 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.700303 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.700453 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.700611 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.700776 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.700936 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.701087 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.701238 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.701389 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.701551 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.701729 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.701884 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.702036 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.702186 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.702348 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.702600 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.702756 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.702918 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.703071 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.703222 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.703384 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.703556 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.703720 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.703907 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.704152 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.704313 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.704712 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.705020 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.705179 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.705347 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.705628 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.705881 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.706057 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.706323 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.706500 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.706669 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.706820 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.706970 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.707138 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.707300 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.707452 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.707603 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.707753 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.707903 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.708067 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.708221 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.708377 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.708546 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.708722 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.709036 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.709717 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.709879 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.710031 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.710182 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.710334 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.710534 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.710534 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.710852 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.711017 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.711169 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.711332 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.711493 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.711722 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.711886 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.712038 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.712198 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.712350 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.712517 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.712677 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.712829 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.712979 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.712979 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.713273 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.713455 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.713609 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.713760 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.713910 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.714069 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.714337 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.714532 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.714954 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.715116 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.715281 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.715442 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.715614 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.715895 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.716130 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.716305 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.716545 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.716713 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.716874 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.717069 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.717231 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.717231 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.717541 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.717703 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.717855 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.718004 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.718166 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.718317 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.718519 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.718686 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.718839 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.719016 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.719247 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.719415 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.719576 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.719737 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.719889 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.720049 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.720208 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.720381 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.720535 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.720687 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.720838 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.720988 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.721145 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.721306 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.721470 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.721630 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.721789 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.721950 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.722110 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.722274 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.722466 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.722625 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.722775 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.722775 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.723078 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.723239 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.723391 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.723542 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.723700 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.723859 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.724021 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.724180 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.724360 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.724673 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.725113 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.725113 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.725427 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.725580 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.725737 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.725924 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.726170 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.726406 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.726664 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.726834 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.726988 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.727163 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.727317 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.727478 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.727639 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.727804 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.727964 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.728121 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.728282 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.728442 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.728602 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.728754 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.728912 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.729063 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.729251 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.729485 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.729668 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.729964 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.730124 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.730286 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.730512 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.730671 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.730831 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.730983 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.731135 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.731286 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.731447 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.731620 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.731773 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.731923 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.732074 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.732224 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.732386 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.732545 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.732698 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.732850 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.733008 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.733167 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.733327 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.733425 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.733505 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.733638 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.733638 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.733910 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.733910 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.734172 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.734172 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.734444 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.734598 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.734812 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.735352 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.735486 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.735618 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.735740 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.735884 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.736300 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.736517 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.736656 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.736849 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.736975 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.737097 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.737219 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.737332 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.737443 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.737554 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.737673 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.737799 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.737911 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.738022 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.738132 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.738256 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.738368 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.738541 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.738675 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.738797 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.738909 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.739019 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.739129 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.739254 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.739367 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.739504 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.739709 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.739834 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.739947 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.740072 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.740224 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.740337 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.740455 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.740568 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.740687 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.740800 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.740911 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.741021 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.741131 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.741249 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.741370 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.741370 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.741586 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.741586 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.741802 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.741802 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.742019 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.742139 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.742250 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.742360 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.742504 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.742621 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.742752 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.742866 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.742984 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.743104 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.743222 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.743343 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.743455 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.743594 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.743721 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.743834 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.744003 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.744134 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.744256 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.745445 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.745677 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.745806 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.745933 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.746063 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.746176 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.746306 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.746534 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.746751 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.746886 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.747084 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.747201 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.747397 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.747528 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.747656 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.747768 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.747888 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.748008 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.748129 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.748241 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.748360 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.748479 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.748592 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.748701 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.748811 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.748921 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.749046 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.749166 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.749286 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.749286 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.749286 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.749286 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.749723 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.749919 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.750044 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.750167 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.750167 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.750385 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.750569 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.750710 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.750832 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.750944 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.751055 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.751180 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.751294 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.751413 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.751526 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.751636 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.751754 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.751879 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.752000 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.752118 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.752229 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.752340 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.752460 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.752578 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.752690 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.752800 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.752910 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.753027 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.753148 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.753267 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.753267 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.753476 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.753600 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.753713 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.753713 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.753971 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.754085 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.754210 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.754323 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.754519 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.754730 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.754847 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.754977 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.755166 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.755291 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.755433 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.755662 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.756404 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.756553 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.756762 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.756949 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.757094 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.757288 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.757412 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.757527 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.757669 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.757804 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.757931 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.758052 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.758172 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.758292 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.758410 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.758610 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.758728 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.758839 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.758957 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.759069 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.759186 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.759313 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.759428 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.759553 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.759666 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.759784 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.759914 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.760117 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.760234 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.760346 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.760464 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.760576 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.760698 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.760817 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.760817 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.761034 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.761144 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.761253 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.761382 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.761502 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.761621 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.761732 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.761842 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.761951 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.762071 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.762182 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.762293 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.762412 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.762607 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.762746 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.762867 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.762987 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.763105 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.763217 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.763327 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.763451 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.763572 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.763692 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.763805 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.763923 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.763923 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.764219 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.767284 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.767523 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.767676 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.767805 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.767928 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.768056 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.768178 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.768292 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.768403 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.768523 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.768645 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.768758 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.768868 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.768986 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.768986 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.769197 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.769330 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.769450 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.769562 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.769673 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.769784 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.769903 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.770029 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.770241 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.770557 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.770678 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.770803 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.770927 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.771049 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.771171 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.771290 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.771511 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.772141 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.772266 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.772387 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.772526 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.772526 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.772740 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.772852 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.772973 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.773086 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.773204 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.773324 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.773436 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.773650 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.773783 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.773910 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.774025 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.774137 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.774248 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.774369 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.774520 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.774634 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.774758 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.774879 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.774999 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.775121 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.775234 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.775234 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.775442 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.775564 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.775683 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.775809 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.775922 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.776041 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.776153 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.776298 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.777367 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.777528 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.777746 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.777865 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.777997 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.778208 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.778341 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.778541 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.778541 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.778777 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.778891 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.779004 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.779132 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.779132 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.779359 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.779518 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.779639 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.779753 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.779949 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.780065 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.780322 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.780446 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.780569 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.780689 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.780812 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.780932 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.781058 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.781171 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.781289 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.781429 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.781665 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.781787 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.781908 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.782022 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.782142 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.782270 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.782639 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.782765 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.791672 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.791875 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.792001 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.792138 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.792254 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.792374 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.792498 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.792611 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.792739 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.792862 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.792975 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.793095 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.793217 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.793332 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.793458 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.793571 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.793689 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.793801 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.793912 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.793912 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.794159 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.794297 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.794412 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.794569 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.794718 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.794852 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.794987 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.795108 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.795228 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.795350 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.795470 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.795603 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.795732 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.795732 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.795941 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.796052 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.796173 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.796309 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.796430 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.796561 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.796720 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.796842 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.797008 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.797136 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.797249 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.797360 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.797480 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.797592 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.797710 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.798087 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.798358 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.798680 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.798816 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.798947 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.799076 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.799225 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.799347 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.799468 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.799598 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.799714 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.799846 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.799961 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.800946 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.801080 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.801080 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.801302 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.801424 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.801539 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.801667 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.801787 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.801900 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.802032 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.802153 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.802265 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.804046 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.804196 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.804312 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.804424 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.804536 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.804658 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.804789 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.804960 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.805130 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.805289 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.805445 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.805608 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.805757 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.805903 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.806049 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.806217 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.806373 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.806560 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.806718 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.806866 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.808683 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.809045 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.809221 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.809392 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.809542 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.809697 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.809845 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.810010 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.810172 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.810508 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.810681 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.810839 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.810996 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.811151 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.811312 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.811459 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.811606 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.811760 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.811916 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.812094 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.812243 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.812389 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.812536 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.812681 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.812836 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.812993 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.813142 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.813294 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.813451 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.813598 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.813752 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.813909 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.814091 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.814243 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.814391 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.814583 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.814732 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.814893 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.815096 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.815245 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.815392 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.815392 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.815681 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.815829 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.815996 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.815996 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.816284 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.816284 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.816824 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.816929 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.817015 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.817107 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.817198 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.817283 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.817283 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.817458 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.817555 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.817640 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.817721 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.817822 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.817967 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.818050 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.818120 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.818208 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.818328 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.818546 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.818638 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.819030 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.819113 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.819184 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.819254 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.819333 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.819405 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.819480 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.819550 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.819628 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.819711 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.819806 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.819898 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.819981 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.820063 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.820145 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.820232 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.820310 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.820393 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.820497 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.820581 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.820663 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.820755 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.820847 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.820937 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.821026 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.821109 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.821197 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.821294 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.821378 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.821467 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.821467 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.821624 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.821714 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.821806 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.821888 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.821976 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.822066 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.822158 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.822250 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.822333 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.822628 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.822742 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.822842 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.822936 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.823035 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.823035 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 04 18:00:02.823196 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.823196 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.823196 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.823196 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.823196 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.823196 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.823196 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.823196 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.823808 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.823808 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.823808 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.823808 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.823808 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.823808 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.823808 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.823808 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.824546 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.824546 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.824546 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.824546 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.824546 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.824546 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.824546 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.824546 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.825040 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.825040 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.825040 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.825040 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.825040 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.825040 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.825040 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.825040 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.825530 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.825530 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.825530 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.825530 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.825530 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.825530 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.825530 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.825530 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.826007 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.826007 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.826007 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.826007 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.826007 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.826007 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.826007 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.826007 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.826523 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.826523 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.826523 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.826523 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.826523 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.826523 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.826523 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.826974 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.826974 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.827354 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.827919 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.828025 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.828269 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.828610 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.828917 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.829241 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.829498 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_db.sqlalchemy.engines [None req-18e8d713-a2a3-43cb-aeb7-192a2ff5929a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123566) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 04 18:00:02.829618 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.829920 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.830249 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.830598 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.831046 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.831371 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.831706 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.832041 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.832363 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.832701 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.833044 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.833367 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.833706 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.834095 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.834467 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.834818 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.835161 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.835500 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.835820 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.836140 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.836459 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.836783 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.837246 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.837648 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.837982 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.838323 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.838679 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.839018 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.839343 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.839680 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.840014 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.840350 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.840674 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.841022 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.841346 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.841670 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.841994 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.842317 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.842832 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.843076 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.843474 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.843814 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.844135 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.844472 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.844803 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.845185 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.845679 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.845863 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.846201 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.846550 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.853092 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.853092 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.853092 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.853092 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.853092 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.853092 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.853092 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.853092 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.854611 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.854611 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.854611 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.854611 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.854611 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.854611 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.854611 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.854611 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 04 18:00:02.855390 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 04 18:00:02.877593 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_db.sqlalchemy.engines [None req-8642839c-da61-4f36-99bd-055e7648a399 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 04 18:00:02.896702 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.context [None req-18e8d713-a2a3-43cb-aeb7-192a2ff5929a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),97b60c31-2cf9-4488-ba33-21689903d427(cell1) {{(pid=123566) load_cells /opt/stack/nova/nova/context.py:464}} Feb 04 18:00:02.901144 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-18e8d713-a2a3-43cb-aeb7-192a2ff5929a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:02.902840 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-18e8d713-a2a3-43cb-aeb7-192a2ff5929a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:02.903718 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-18e8d713-a2a3-43cb-aeb7-192a2ff5929a None None] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:02.905784 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-18e8d713-a2a3-43cb-aeb7-192a2ff5929a None None] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:02.918373 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_db.sqlalchemy.engines [None req-18e8d713-a2a3-43cb-aeb7-192a2ff5929a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123566) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 04 18:00:02.919308 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_db.sqlalchemy.engines [None req-18e8d713-a2a3-43cb-aeb7-192a2ff5929a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123566) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 04 18:00:02.944517 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.context [None req-8642839c-da61-4f36-99bd-055e7648a399 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),97b60c31-2cf9-4488-ba33-21689903d427(cell1) {{(pid=123567) load_cells /opt/stack/nova/nova/context.py:464}} Feb 04 18:00:02.948895 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8642839c-da61-4f36-99bd-055e7648a399 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:02.950535 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8642839c-da61-4f36-99bd-055e7648a399 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:02.951360 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8642839c-da61-4f36-99bd-055e7648a399 None None] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:02.953327 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8642839c-da61-4f36-99bd-055e7648a399 None None] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:02.965135 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_db.sqlalchemy.engines [None req-8642839c-da61-4f36-99bd-055e7648a399 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 04 18:00:02.966014 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_db.sqlalchemy.engines [None req-8642839c-da61-4f36-99bd-055e7648a399 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 04 18:00:03.080682 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_db.sqlalchemy.engines [None req-18e8d713-a2a3-43cb-aeb7-192a2ff5929a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123566) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 04 18:00:03.130652 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_db.sqlalchemy.engines [None req-8642839c-da61-4f36-99bd-055e7648a399 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 04 18:00:03.406654 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: WARNING keystonemiddleware.auth_token [None req-18e8d713-a2a3-43cb-aeb7-192a2ff5929a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 04 18:00:03.413360 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: WARNING keystonemiddleware.auth_token [None req-18e8d713-a2a3-43cb-aeb7-192a2ff5929a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 04 18:00:03.466255 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: WARNING keystonemiddleware.auth_token [None req-8642839c-da61-4f36-99bd-055e7648a399 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 04 18:00:03.473411 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: WARNING keystonemiddleware.auth_token [None req-8642839c-da61-4f36-99bd-055e7648a399 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 04 18:00:03.759973 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: WARNING keystonemiddleware.auth_token [None req-18e8d713-a2a3-43cb-aeb7-192a2ff5929a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 04 18:00:03.765292 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: WARNING keystonemiddleware.auth_token [None req-18e8d713-a2a3-43cb-aeb7-192a2ff5929a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 04 18:00:03.770830 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55afab4c19c0 pid: 123566 (default app) Feb 04 18:00:03.821880 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: WARNING keystonemiddleware.auth_token [None req-8642839c-da61-4f36-99bd-055e7648a399 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 04 18:00:03.827670 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: WARNING keystonemiddleware.auth_token [None req-8642839c-da61-4f36-99bd-055e7648a399 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 04 18:00:03.833260 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55afab4c19c0 pid: 123567 (default app) Feb 04 18:00:43.310617 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-fa9225eb-7953-4986-abb6-de116123aed8 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1791120567", "imageRef": "b0fb57f5-967d-4692-94f3-accee37910c3", "flavorRef": "452", "networks": [{"uuid": "6dd0ca80-0c83-4ea4-98da-6bee3a373147"}]}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:00:44.255330 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.network.neutron [None req-fa9225eb-7953-4986-abb6-de116123aed8 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] validate_networks() for [('6dd0ca80-0c83-4ea4-98da-6bee3a373147', None, None, None, None, None)] {{(pid=123566) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 04 18:00:44.333707 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-27e374c5-584b-4057-a8a4-5dd724896736 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-818376875", "imageRef": "b0fb57f5-967d-4692-94f3-accee37910c3", "flavorRef": "452", "networks": [{"uuid": "3dc2f191-988b-4e16-974b-c84a0b6125d2"}]}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:00:44.865836 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.network.neutron [None req-27e374c5-584b-4057-a8a4-5dd724896736 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] validate_networks() for [('3dc2f191-988b-4e16-974b-c84a0b6125d2', None, None, None, None, None)] {{(pid=123567) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 04 18:00:45.407414 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-fa9225eb-7953-4986-abb6-de116123aed8 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Flavor limits 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 04 18:00:45.412764 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-fa9225eb-7953-4986-abb6-de116123aed8 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Image limits 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 04 18:00:45.412764 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-fa9225eb-7953-4986-abb6-de116123aed8 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Flavor pref 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 04 18:00:45.412764 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-fa9225eb-7953-4986-abb6-de116123aed8 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Image pref 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 04 18:00:45.412764 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-fa9225eb-7953-4986-abb6-de116123aed8 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 04 18:00:45.433243 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fa9225eb-7953-4986-abb6-de116123aed8 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:45.435077 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fa9225eb-7953-4986-abb6-de116123aed8 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:45.436274 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fa9225eb-7953-4986-abb6-de116123aed8 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:45.437011 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fa9225eb-7953-4986-abb6-de116123aed8 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:45.482280 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-fa9225eb-7953-4986-abb6-de116123aed8 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Getting quotas for project 00a6093b8812451283ddc89510d3000a. Resources: {'cores', 'ram', 'instances'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:00:45.489882 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-fa9225eb-7953-4986-abb6-de116123aed8 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Getting quotas for user 7908f45bdeae40b6b31a7b5fd0d1c2a6 and project 00a6093b8812451283ddc89510d3000a. Resources: {'cores', 'ram', 'instances'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:00:45.509056 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-fa9225eb-7953-4986-abb6-de116123aed8 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Going to run 1 instances... {{(pid=123566) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 04 18:00:45.512754 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-fa9225eb-7953-4986-abb6-de116123aed8 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0fb57f5-967d-4692-94f3-accee37910c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 04 18:00:45.784385 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-fa9225eb-7953-4986-abb6-de116123aed8 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.293417 Feb 04 18:00:45.786006 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 1/1] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Feb 4 18:00:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3298 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 04 18:00:45.792192 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-af75f966-18a0-4a81-b1ab-e5c19cbe1e1a tempest-VolumesTestJSON-359736985 tempest-VolumesTestJSON-359736985-project] Calling method '.version_select at 0x7fe8cdd4c700>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:45.921209 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-27e374c5-584b-4057-a8a4-5dd724896736 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Flavor limits 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 04 18:00:45.927459 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-27e374c5-584b-4057-a8a4-5dd724896736 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Image limits 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 04 18:00:45.928133 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-27e374c5-584b-4057-a8a4-5dd724896736 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Flavor pref 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 04 18:00:45.929239 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-27e374c5-584b-4057-a8a4-5dd724896736 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Image pref 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 04 18:00:45.933252 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-27e374c5-584b-4057-a8a4-5dd724896736 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 04 18:00:45.950327 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-af75f966-18a0-4a81-b1ab-e5c19cbe1e1a tempest-VolumesTestJSON-359736985 tempest-VolumesTestJSON-359736985-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/f79b3b8a-56b4-475c-ad26-3530ebce4d56" status: 200 len: 351 microversion: 2.1 time: 0.162425 Feb 04 18:00:45.952861 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 2/2] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Feb 4 18:00:45 2022] GET /compute/v2.1/os-volumes/f79b3b8a-56b4-475c-ad26-3530ebce4d56 => generated 351 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:00:45.969606 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-75d7b617-d3a4-45f6-9bb8-9a683828896f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:45.974698 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-75d7b617-d3a4-45f6-9bb8-9a683828896f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:00:45.997247 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-27e374c5-584b-4057-a8a4-5dd724896736 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:45.997247 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-27e374c5-584b-4057-a8a4-5dd724896736 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:45.997247 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-27e374c5-584b-4057-a8a4-5dd724896736 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:45.997247 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-27e374c5-584b-4057-a8a4-5dd724896736 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:46.032911 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-27e374c5-584b-4057-a8a4-5dd724896736 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Getting quotas for project c4a8ffd2aaf14a21a0545cb345ab262f. Resources: {'cores', 'ram', 'instances'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:00:46.042220 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-27e374c5-584b-4057-a8a4-5dd724896736 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Getting quotas for user e9bd306bfd5f4867b300ada22547897f and project c4a8ffd2aaf14a21a0545cb345ab262f. Resources: {'cores', 'ram', 'instances'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:00:46.060079 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-27e374c5-584b-4057-a8a4-5dd724896736 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Going to run 1 instances... {{(pid=123567) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 04 18:00:46.064727 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-27e374c5-584b-4057-a8a4-5dd724896736 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0fb57f5-967d-4692-94f3-accee37910c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 04 18:00:46.304446 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-75d7b617-d3a4-45f6-9bb8-9a683828896f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:00:46.333695 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-75d7b617-d3a4-45f6-9bb8-9a683828896f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1215 microversion: 2.1 time: 0.381186 Feb 04 18:00:46.343798 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 3/3] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:00:45 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1215 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:00:46.392894 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-27e374c5-584b-4057-a8a4-5dd724896736 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.223364 Feb 04 18:00:46.399212 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 1/4] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Feb 4 18:00:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 04 18:00:46.405165 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-9c1c79a1-f70a-4073-8e53-244469c956eb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:46.411218 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-9c1c79a1-f70a-4073-8e53-244469c956eb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:00:46.608242 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-9c1c79a1-f70a-4073-8e53-244469c956eb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:00:46.623020 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-9c1c79a1-f70a-4073-8e53-244469c956eb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1217 microversion: 2.1 time: 0.221746 Feb 04 18:00:46.626849 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 4/5] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:00:46 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1217 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:00:47.351359 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e406a11f-beab-4e81-85f3-55203164463d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:47.351978 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-e406a11f-beab-4e81-85f3-55203164463d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:00:47.511873 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e406a11f-beab-4e81-85f3-55203164463d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:00:47.540227 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e406a11f-beab-4e81-85f3-55203164463d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1215 microversion: 2.1 time: 0.192641 Feb 04 18:00:47.542170 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 2/6] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:00:47 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1215 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:00:47.648756 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-0df12d3e-777e-48c9-ae1d-b0eff3918225 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:47.650052 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-0df12d3e-777e-48c9-ae1d-b0eff3918225 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:00:47.923744 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-0df12d3e-777e-48c9-ae1d-b0eff3918225 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:00:47.938855 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-0df12d3e-777e-48c9-ae1d-b0eff3918225 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1217 microversion: 2.1 time: 0.295591 Feb 04 18:00:47.955982 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 5/7] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:00:47 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1217 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:00:48.558512 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a05eefd6-52cb-40cc-a2c9-592fd84c1649 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:48.559784 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-a05eefd6-52cb-40cc-a2c9-592fd84c1649 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:00:48.775383 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-a05eefd6-52cb-40cc-a2c9-592fd84c1649 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:00:48.782528 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a05eefd6-52cb-40cc-a2c9-592fd84c1649 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1215 microversion: 2.1 time: 0.227677 Feb 04 18:00:48.791221 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 3/8] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:00:48 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1215 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:00:48.963779 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-adebab09-2879-4d31-8204-62163ea2f6c0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:48.964818 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-adebab09-2879-4d31-8204-62163ea2f6c0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:00:49.419145 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-adebab09-2879-4d31-8204-62163ea2f6c0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:00:49.450281 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-adebab09-2879-4d31-8204-62163ea2f6c0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1217 microversion: 2.1 time: 0.490415 Feb 04 18:00:49.451678 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 6/9] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:00:48 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1217 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:00:49.808269 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-960683b0-ae34-4c78-971b-fa23059772c2 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:49.809161 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-960683b0-ae34-4c78-971b-fa23059772c2 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:00:49.820178 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-960683b0-ae34-4c78-971b-fa23059772c2 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:49.820964 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-960683b0-ae34-4c78-971b-fa23059772c2 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:49.821974 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-960683b0-ae34-4c78-971b-fa23059772c2 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:49.825191 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-960683b0-ae34-4c78-971b-fa23059772c2 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:49.991808 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-960683b0-ae34-4c78-971b-fa23059772c2 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:00:49.997189 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-960683b0-ae34-4c78-971b-fa23059772c2 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1219 microversion: 2.1 time: 0.192472 Feb 04 18:00:49.997979 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 4/10] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:00:49 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1219 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:00:50.062458 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-39d320d1-7abc-4d8d-ba99-4355339b0017 tempest-VolumesTestJSON-359736985 tempest-VolumesTestJSON-359736985-project] Calling method '.version_select at 0x7fe8cdd4c8b0>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:50.118819 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-39d320d1-7abc-4d8d-ba99-4355339b0017 tempest-VolumesTestJSON-359736985 tempest-VolumesTestJSON-359736985-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/2085acf4-6dc1-4270-a7f2-b86d19efa789" status: 200 len: 350 microversion: 2.1 time: 0.059931 Feb 04 18:00:50.119592 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 7/11] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Feb 4 18:00:50 2022] GET /compute/v2.1/os-volumes/2085acf4-6dc1-4270-a7f2-b86d19efa789 => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:00:50.469682 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-bcceb275-21a2-43e0-bdba-036f58f2396e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:50.470628 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-bcceb275-21a2-43e0-bdba-036f58f2396e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:00:50.481575 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bcceb275-21a2-43e0-bdba-036f58f2396e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:50.485275 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bcceb275-21a2-43e0-bdba-036f58f2396e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:50.485275 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bcceb275-21a2-43e0-bdba-036f58f2396e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:50.485275 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bcceb275-21a2-43e0-bdba-036f58f2396e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:50.619449 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-bcceb275-21a2-43e0-bdba-036f58f2396e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:00:50.639547 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-bcceb275-21a2-43e0-bdba-036f58f2396e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1221 microversion: 2.1 time: 0.174431 Feb 04 18:00:50.643240 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 5/12] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:00:50 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1221 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:00:51.025410 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-da7b6ccb-8649-459d-b7b5-5f14473b127f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:51.026485 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-da7b6ccb-8649-459d-b7b5-5f14473b127f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:00:51.042186 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-da7b6ccb-8649-459d-b7b5-5f14473b127f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:51.048110 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-da7b6ccb-8649-459d-b7b5-5f14473b127f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:51.049486 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-da7b6ccb-8649-459d-b7b5-5f14473b127f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:51.051294 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-da7b6ccb-8649-459d-b7b5-5f14473b127f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:51.238269 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-da7b6ccb-8649-459d-b7b5-5f14473b127f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:00:51.262692 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-da7b6ccb-8649-459d-b7b5-5f14473b127f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1211 microversion: 2.1 time: 0.249762 Feb 04 18:00:51.272980 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 8/13] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:00:51 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1211 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:00:51.660203 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b507a31f-7978-43f2-8b40-cb8367c4a77f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:51.660869 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-b507a31f-7978-43f2-8b40-cb8367c4a77f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:00:51.668828 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b507a31f-7978-43f2-8b40-cb8367c4a77f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:51.673969 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b507a31f-7978-43f2-8b40-cb8367c4a77f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:51.673969 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b507a31f-7978-43f2-8b40-cb8367c4a77f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:51.673969 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b507a31f-7978-43f2-8b40-cb8367c4a77f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:51.836122 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-b507a31f-7978-43f2-8b40-cb8367c4a77f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:00:51.846164 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b507a31f-7978-43f2-8b40-cb8367c4a77f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1269 microversion: 2.1 time: 0.188807 Feb 04 18:00:51.856155 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 6/14] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:00:51 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1269 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:00:52.295761 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-7f0cad19-dd54-474f-8743-9b821da30113 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:52.296715 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-7f0cad19-dd54-474f-8743-9b821da30113 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:00:52.318923 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7f0cad19-dd54-474f-8743-9b821da30113 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:52.318923 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7f0cad19-dd54-474f-8743-9b821da30113 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:52.318923 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7f0cad19-dd54-474f-8743-9b821da30113 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:52.318923 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7f0cad19-dd54-474f-8743-9b821da30113 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:52.473223 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-7f0cad19-dd54-474f-8743-9b821da30113 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:00:52.491603 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-7f0cad19-dd54-474f-8743-9b821da30113 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1275 microversion: 2.1 time: 0.206191 Feb 04 18:00:52.494406 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 9/15] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:00:52 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1275 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:00:52.869118 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-4fb744a9-8195-41b8-b463-46a6898cefc5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:52.869783 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-4fb744a9-8195-41b8-b463-46a6898cefc5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:00:52.882754 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4fb744a9-8195-41b8-b463-46a6898cefc5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:52.883216 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4fb744a9-8195-41b8-b463-46a6898cefc5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:52.884027 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4fb744a9-8195-41b8-b463-46a6898cefc5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:52.884478 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4fb744a9-8195-41b8-b463-46a6898cefc5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:53.096865 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-4fb744a9-8195-41b8-b463-46a6898cefc5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:00:53.107426 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-4fb744a9-8195-41b8-b463-46a6898cefc5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1275 microversion: 2.1 time: 0.249961 Feb 04 18:00:53.114869 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 7/16] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:00:52 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1275 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:00:53.293782 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a9c60bd8-7562-4850-a854-1af20acfc2eb tempest-VolumesTestJSON-359736985 tempest-VolumesTestJSON-359736985-project] Calling method '.version_select at 0x7fe8ccc2a940>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:53.380296 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a9c60bd8-7562-4850-a854-1af20acfc2eb tempest-VolumesTestJSON-359736985 tempest-VolumesTestJSON-359736985-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/14e91bf4-b23d-46ba-bdc0-ccc8ae63be1d" status: 200 len: 351 microversion: 2.1 time: 0.090950 Feb 04 18:00:53.380895 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 8/17] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Feb 4 18:00:53 2022] GET /compute/v2.1/os-volumes/14e91bf4-b23d-46ba-bdc0-ccc8ae63be1d => generated 351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:00:53.393458 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-597e1dd0-7a5f-4269-87c4-30be283bad86 tempest-VolumesTestJSON-359736985 tempest-VolumesTestJSON-359736985-project] Calling method '.version_select at 0x7fe8ccc8b4c0>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:53.414209 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-3833b7e5-675b-4dd9-90cb-6b512972d557 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Action: 'create', calling method: .version_select at 0x7fe8ccbafa60>, body: {"keypair": {"name": "tempest-keypair-2139143506"}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:00:53.471400 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-3833b7e5-675b-4dd9-90cb-6b512972d557 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Getting quotas for project 745beddd0c154d82a7e95298706587b1. Resources: {'key_pairs'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:00:53.482363 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-3833b7e5-675b-4dd9-90cb-6b512972d557 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Getting quotas for user 74e23ced236b429c8aab135f45fe3e01 and project 745beddd0c154d82a7e95298706587b1. Resources: {'key_pairs'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:00:53.729664 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-597e1dd0-7a5f-4269-87c4-30be283bad86 tempest-VolumesTestJSON-359736985 tempest-VolumesTestJSON-359736985-project] 10.222.0.98 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.339745 Feb 04 18:00:53.730749 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 9/18] 10.222.0.98 () {58 vars in 1133 bytes} [Fri Feb 4 18:00:53 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:00:53.735491 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-65c637a4-8df3-471d-b1e9-c19f44e4862f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:53.736234 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-65c637a4-8df3-471d-b1e9-c19f44e4862f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:00:53.755544 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-65c637a4-8df3-471d-b1e9-c19f44e4862f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:53.756347 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-65c637a4-8df3-471d-b1e9-c19f44e4862f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:53.757380 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-65c637a4-8df3-471d-b1e9-c19f44e4862f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:53.758016 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-65c637a4-8df3-471d-b1e9-c19f44e4862f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:54.036778 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-3833b7e5-675b-4dd9-90cb-6b512972d557 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Getting quotas for project 745beddd0c154d82a7e95298706587b1. Resources: {'key_pairs'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:00:54.048792 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-3833b7e5-675b-4dd9-90cb-6b512972d557 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Getting quotas for user 74e23ced236b429c8aab135f45fe3e01 and project 745beddd0c154d82a7e95298706587b1. Resources: {'key_pairs'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:00:54.082874 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-3833b7e5-675b-4dd9-90cb-6b512972d557 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.170280 Feb 04 18:00:54.084202 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 10/19] 10.222.0.98 () {62 vars in 1198 bytes} [Fri Feb 4 18:00:52 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1172 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Feb 04 18:00:54.290907 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-65c637a4-8df3-471d-b1e9-c19f44e4862f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:00:54.352655 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-65c637a4-8df3-471d-b1e9-c19f44e4862f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1273 microversion: 2.1 time: 0.617019 Feb 04 18:00:54.378781 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 10/20] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:00:53 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1273 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:00:54.387636 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-6bf095dc-a0cb-4edc-bbdb-cc8abaf6cf4c tempest-VolumesTestJSON-359736985 tempest-VolumesTestJSON-359736985-project] Calling method '.version_select at 0x7fe8ccbb09d0>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:54.650719 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-6bf095dc-a0cb-4edc-bbdb-cc8abaf6cf4c tempest-VolumesTestJSON-359736985 tempest-VolumesTestJSON-359736985-project] 10.222.0.98 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.285676 Feb 04 18:00:54.659150 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 11/21] 10.222.0.98 () {58 vars in 1148 bytes} [Fri Feb 4 18:00:54 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:00:54.659150 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3c4055e8-26e5-4232-b67b-4330215a7b91 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:54.666114 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-3c4055e8-26e5-4232-b67b-4330215a7b91 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:00:54.689561 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-6347f18f-775e-4c8f-a911-b9dbfad6ae54 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1431607586", "imageRef": "b0fb57f5-967d-4692-94f3-accee37910c3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:00:54.709925 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3c4055e8-26e5-4232-b67b-4330215a7b91 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:54.715928 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3c4055e8-26e5-4232-b67b-4330215a7b91 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:54.720507 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3c4055e8-26e5-4232-b67b-4330215a7b91 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:54.721326 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3c4055e8-26e5-4232-b67b-4330215a7b91 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:54.851095 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.network.neutron [None req-6347f18f-775e-4c8f-a911-b9dbfad6ae54 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] validate_networks() for [('9c690480-f668-45a1-920e-e1d3e188eb0c', None, None, None, None, None)] {{(pid=123566) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 04 18:00:55.769212 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-3c4055e8-26e5-4232-b67b-4330215a7b91 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:00:55.796273 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-3c4055e8-26e5-4232-b67b-4330215a7b91 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 1.130584 Feb 04 18:00:55.799156 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 12/22] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:00:54 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:00:55.814122 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-d402b17f-7ffe-487c-83bf-274b8e4eb1c4 tempest-VolumesTestJSON-359736985 tempest-VolumesTestJSON-359736985-project] Calling method '.version_select at 0x7fe8ccbb0670>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:56.132737 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-d402b17f-7ffe-487c-83bf-274b8e4eb1c4 tempest-VolumesTestJSON-359736985 tempest-VolumesTestJSON-359736985-project] 10.222.0.98 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.332170 Feb 04 18:00:56.134132 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 13/23] 10.222.0.98 () {58 vars in 1133 bytes} [Fri Feb 4 18:00:55 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:00:56.140232 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-93ec3436-7fdd-4ee4-803b-a36c75fbf0c5 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:56.141113 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-93ec3436-7fdd-4ee4-803b-a36c75fbf0c5 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:00:56.167888 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-93ec3436-7fdd-4ee4-803b-a36c75fbf0c5 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:56.168351 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-93ec3436-7fdd-4ee4-803b-a36c75fbf0c5 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:56.169156 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-93ec3436-7fdd-4ee4-803b-a36c75fbf0c5 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:56.169600 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-93ec3436-7fdd-4ee4-803b-a36c75fbf0c5 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:57.278747 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-93ec3436-7fdd-4ee4-803b-a36c75fbf0c5 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:00:57.296227 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-93ec3436-7fdd-4ee4-803b-a36c75fbf0c5 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 1.160930 Feb 04 18:00:57.296848 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 14/24] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:00:56 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:00:57.328998 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-2e8df150-467c-4284-ab85-827c9d7450af tempest-VolumesTestJSON-359736985 tempest-VolumesTestJSON-359736985-project] Calling method '.version_select at 0x7fe8ccbb0af0>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:57.567235 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-6347f18f-775e-4c8f-a911-b9dbfad6ae54 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Flavor limits 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 04 18:00:57.568354 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-6347f18f-775e-4c8f-a911-b9dbfad6ae54 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Image limits 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 04 18:00:57.568983 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-6347f18f-775e-4c8f-a911-b9dbfad6ae54 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Flavor pref 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 04 18:00:57.569540 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-6347f18f-775e-4c8f-a911-b9dbfad6ae54 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Image pref 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 04 18:00:57.572426 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-6347f18f-775e-4c8f-a911-b9dbfad6ae54 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 04 18:00:57.596376 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6347f18f-775e-4c8f-a911-b9dbfad6ae54 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:57.597418 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6347f18f-775e-4c8f-a911-b9dbfad6ae54 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:57.605946 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6347f18f-775e-4c8f-a911-b9dbfad6ae54 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:57.606571 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6347f18f-775e-4c8f-a911-b9dbfad6ae54 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:57.665005 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-2e8df150-467c-4284-ab85-827c9d7450af tempest-VolumesTestJSON-359736985 tempest-VolumesTestJSON-359736985-project] 10.222.0.98 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.357898 Feb 04 18:00:57.666320 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 15/25] 10.222.0.98 () {58 vars in 1166 bytes} [Fri Feb 4 18:00:57 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:00:57.687188 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-ada37858-1cdb-449d-8dd9-9dabfdcd1591 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:57.690309 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-6347f18f-775e-4c8f-a911-b9dbfad6ae54 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Getting quotas for project 88f3b231bd8d4b4ead414b5d72ec8f7e. Resources: {'cores', 'ram', 'instances'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:00:57.695910 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-ada37858-1cdb-449d-8dd9-9dabfdcd1591 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:00:57.696713 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-6347f18f-775e-4c8f-a911-b9dbfad6ae54 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Getting quotas for user 851ffad2aa464fca8861b9735217a039 and project 88f3b231bd8d4b4ead414b5d72ec8f7e. Resources: {'cores', 'ram', 'instances'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:00:57.712563 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-6347f18f-775e-4c8f-a911-b9dbfad6ae54 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Going to run 1 instances... {{(pid=123566) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 04 18:00:57.712959 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ada37858-1cdb-449d-8dd9-9dabfdcd1591 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:57.713703 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ada37858-1cdb-449d-8dd9-9dabfdcd1591 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:57.715130 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-6347f18f-775e-4c8f-a911-b9dbfad6ae54 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0fb57f5-967d-4692-94f3-accee37910c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 04 18:00:57.717907 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ada37858-1cdb-449d-8dd9-9dabfdcd1591 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:57.718477 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ada37858-1cdb-449d-8dd9-9dabfdcd1591 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:57.946050 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-6347f18f-775e-4c8f-a911-b9dbfad6ae54 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.860429 Feb 04 18:00:57.947052 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 11/26] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Feb 4 18:00:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 3862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 04 18:00:57.963756 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-5703ea34-7051-4d26-a4a8-be6618501105 tempest-VolumesTestJSON-359736985 tempest-VolumesTestJSON-359736985-project] Calling method '.version_select at 0x7fe8ccbafca0>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:58.181884 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-5703ea34-7051-4d26-a4a8-be6618501105 tempest-VolumesTestJSON-359736985 tempest-VolumesTestJSON-359736985-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.233743 Feb 04 18:00:58.183108 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 12/27] 10.222.0.98 () {58 vars in 1169 bytes} [Fri Feb 4 18:00:57 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:00:58.189173 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b0263215-9209-43a7-8a2e-afcdd7de4605 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:58.190609 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-b0263215-9209-43a7-8a2e-afcdd7de4605 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:00:58.390146 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-b0263215-9209-43a7-8a2e-afcdd7de4605 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:00:58.399439 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-b0263215-9209-43a7-8a2e-afcdd7de4605 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1222 microversion: 2.1 time: 0.214944 Feb 04 18:00:58.402115 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 13/28] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:00:58 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1222 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:00:58.419263 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-871d0879-0ad6-4414-a828-7e4fa286b906 tempest-VolumesTestJSON-359736985 tempest-VolumesTestJSON-359736985-project] Calling method '.version_select at 0x7fe8ccbaa3a0>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:58.575857 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-871d0879-0ad6-4414-a828-7e4fa286b906 tempest-VolumesTestJSON-359736985 tempest-VolumesTestJSON-359736985-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.161837 Feb 04 18:00:58.583811 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 14/29] 10.222.0.98 () {58 vars in 1154 bytes} [Fri Feb 4 18:00:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:00:58.596392 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-be1f6b69-e640-4604-9cd9-7e87c89bbf31 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:58.596392 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-be1f6b69-e640-4604-9cd9-7e87c89bbf31 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:00:58.606270 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-be1f6b69-e640-4604-9cd9-7e87c89bbf31 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:58.615650 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-be1f6b69-e640-4604-9cd9-7e87c89bbf31 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:58.618115 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-be1f6b69-e640-4604-9cd9-7e87c89bbf31 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:00:58.618892 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-be1f6b69-e640-4604-9cd9-7e87c89bbf31 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:00:59.085513 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ada37858-1cdb-449d-8dd9-9dabfdcd1591 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:00:59.085513 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-ada37858-1cdb-449d-8dd9-9dabfdcd1591 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 1.350465 Feb 04 18:00:59.085513 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 16/30] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:00:57 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:00:59.085513 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-fcbec9bb-4c02-4022-b169-1d5997980f39 tempest-VolumesTestJSON-359736985 tempest-VolumesTestJSON-359736985-project] Calling method '.version_select at 0x7fe8ccbc5280>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:59.132636 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-fcbec9bb-4c02-4022-b169-1d5997980f39 tempest-VolumesTestJSON-359736985 tempest-VolumesTestJSON-359736985-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.108448 Feb 04 18:00:59.133325 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 17/31] 10.222.0.98 () {58 vars in 1187 bytes} [Fri Feb 4 18:00:59 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:00:59.138870 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-686fd941-6546-4673-9ccd-65d2e8d26cf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1850882306", "imageRef": "b0fb57f5-967d-4692-94f3-accee37910c3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:00:59.247683 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.network.neutron [None req-686fd941-6546-4673-9ccd-65d2e8d26cf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] validate_networks() for [('9c690480-f668-45a1-920e-e1d3e188eb0c', None, None, None, None, None)] {{(pid=123567) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 04 18:00:59.619257 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-be1f6b69-e640-4604-9cd9-7e87c89bbf31 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:00:59.651820 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-be1f6b69-e640-4604-9cd9-7e87c89bbf31 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 1.065052 Feb 04 18:00:59.655062 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 15/32] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:00:58 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:00:59.701586 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b69936b6-7660-4e7a-a4fb-7624e9572fb7 tempest-VolumesTestJSON-359736985 tempest-VolumesTestJSON-359736985-project] Calling method '.version_select at 0x7fe8cc3599d0>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:00:59.844364 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-b69936b6-7660-4e7a-a4fb-7624e9572fb7 tempest-VolumesTestJSON-359736985 tempest-VolumesTestJSON-359736985-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.185512 Feb 04 18:00:59.844940 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 16/33] 10.222.0.98 () {58 vars in 1154 bytes} [Fri Feb 4 18:00:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:00.110208 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b296dcaf-7975-4f71-a82f-3dbb7b35c5fa tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:00.113659 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-b296dcaf-7975-4f71-a82f-3dbb7b35c5fa tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:00.123392 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b296dcaf-7975-4f71-a82f-3dbb7b35c5fa tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:00.124217 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b296dcaf-7975-4f71-a82f-3dbb7b35c5fa tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:00.125145 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b296dcaf-7975-4f71-a82f-3dbb7b35c5fa tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:00.126039 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b296dcaf-7975-4f71-a82f-3dbb7b35c5fa tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:01.014383 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-b296dcaf-7975-4f71-a82f-3dbb7b35c5fa tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:01.024757 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-b296dcaf-7975-4f71-a82f-3dbb7b35c5fa tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.919619 Feb 04 18:01:01.025668 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 17/34] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:00 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:01.038626 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-54d4809c-3411-4602-b00c-c0b8a92034d0 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:01.039261 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-54d4809c-3411-4602-b00c-c0b8a92034d0 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:01.052287 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-54d4809c-3411-4602-b00c-c0b8a92034d0 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:01.052963 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-54d4809c-3411-4602-b00c-c0b8a92034d0 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:01.053958 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-54d4809c-3411-4602-b00c-c0b8a92034d0 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:01.056790 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-54d4809c-3411-4602-b00c-c0b8a92034d0 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:01.310409 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-686fd941-6546-4673-9ccd-65d2e8d26cf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Flavor limits 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 04 18:01:01.316514 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-686fd941-6546-4673-9ccd-65d2e8d26cf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Image limits 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 04 18:01:01.316514 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-686fd941-6546-4673-9ccd-65d2e8d26cf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Flavor pref 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 04 18:01:01.316514 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-686fd941-6546-4673-9ccd-65d2e8d26cf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Image pref 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 04 18:01:01.316514 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-686fd941-6546-4673-9ccd-65d2e8d26cf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 04 18:01:01.344545 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-686fd941-6546-4673-9ccd-65d2e8d26cf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:01.346204 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-686fd941-6546-4673-9ccd-65d2e8d26cf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:01.350703 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-686fd941-6546-4673-9ccd-65d2e8d26cf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:01.351462 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-686fd941-6546-4673-9ccd-65d2e8d26cf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:01.411263 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-686fd941-6546-4673-9ccd-65d2e8d26cf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Getting quotas for project 88f3b231bd8d4b4ead414b5d72ec8f7e. Resources: {'cores', 'ram', 'instances'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:01:01.420283 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-686fd941-6546-4673-9ccd-65d2e8d26cf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Getting quotas for user 851ffad2aa464fca8861b9735217a039 and project 88f3b231bd8d4b4ead414b5d72ec8f7e. Resources: {'cores', 'ram', 'instances'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:01:01.435247 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-686fd941-6546-4673-9ccd-65d2e8d26cf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Going to run 1 instances... {{(pid=123567) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 04 18:01:01.439121 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-686fd941-6546-4673-9ccd-65d2e8d26cf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0fb57f5-967d-4692-94f3-accee37910c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 04 18:01:01.717387 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-686fd941-6546-4673-9ccd-65d2e8d26cf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.582874 Feb 04 18:01:01.720468 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 18/35] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Feb 4 18:00:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 2587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 04 18:01:01.742446 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-20dd9db9-e953-4725-a968-4f439d058962 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:01.744458 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-20dd9db9-e953-4725-a968-4f439d058962 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:01.926444 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-20dd9db9-e953-4725-a968-4f439d058962 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:01.930408 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-54d4809c-3411-4602-b00c-c0b8a92034d0 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:01.943337 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-54d4809c-3411-4602-b00c-c0b8a92034d0 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.916416 Feb 04 18:01:01.948187 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-20dd9db9-e953-4725-a968-4f439d058962 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1222 microversion: 2.1 time: 0.220657 Feb 04 18:01:01.954215 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 18/36] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:01 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:01.955045 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 19/37] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:01 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1222 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:02.042459 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b7777e52-d695-4c65-af2f-83b41fff8744 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:02.043761 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-b7777e52-d695-4c65-af2f-83b41fff8744 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:02.056971 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b7777e52-d695-4c65-af2f-83b41fff8744 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:02.056971 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b7777e52-d695-4c65-af2f-83b41fff8744 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:02.070130 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b7777e52-d695-4c65-af2f-83b41fff8744 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:02.072159 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b7777e52-d695-4c65-af2f-83b41fff8744 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:02.618637 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-b7777e52-d695-4c65-af2f-83b41fff8744 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:02.631451 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-b7777e52-d695-4c65-af2f-83b41fff8744 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.594003 Feb 04 18:01:02.638041 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 19/38] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:02 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:02.808507 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-b7b65772-6b1d-4bd9-9d27-2b6b6b502ae9 req-ef9a7882-5543-4f99-89d9-974432e204b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1d9c781-2198-40c6-a4ec-cd2422de004d", "tag": "bd315958-9ef0-4c3f-ada4-ba8b1c05202e"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:01:02.816856 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:01:02.816856 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:01:02.870323 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-b7b65772-6b1d-4bd9-9d27-2b6b6b502ae9 req-ef9a7882-5543-4f99-89d9-974432e204b0 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:02.871090 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-b7b65772-6b1d-4bd9-9d27-2b6b6b502ae9 req-ef9a7882-5543-4f99-89d9-974432e204b0 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:02.959704 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-b7b65772-6b1d-4bd9-9d27-2b6b6b502ae9 req-ef9a7882-5543-4f99-89d9-974432e204b0 service nova] Creating event network-changed:bd315958-9ef0-4c3f-ada4-ba8b1c05202e for instance c1d9c781-2198-40c6-a4ec-cd2422de004d on hv-cinder-82276 Feb 04 18:01:02.964562 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-b7b65772-6b1d-4bd9-9d27-2b6b6b502ae9 req-ef9a7882-5543-4f99-89d9-974432e204b0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 04 18:01:02.977266 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-9f6f27e0-ab32-42fc-a274-3cfb5b908f0d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:02.979583 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-9f6f27e0-ab32-42fc-a274-3cfb5b908f0d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:02.989301 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-86370776-1081-4756-bbf8-d8dbbd4966a8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:02.989301 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-86370776-1081-4756-bbf8-d8dbbd4966a8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:02.989301 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-86370776-1081-4756-bbf8-d8dbbd4966a8 None None] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:02.989301 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-86370776-1081-4756-bbf8-d8dbbd4966a8 None None] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:03.003353 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.compute.rpcapi [None req-86370776-1081-4756-bbf8-d8dbbd4966a8 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Feb 04 18:01:03.004473 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-86370776-1081-4756-bbf8-d8dbbd4966a8 None None] Releasing lock "compute-rpcapi-router" {{(pid=123567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 04 18:01:03.010360 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9f6f27e0-ab32-42fc-a274-3cfb5b908f0d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:03.012281 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9f6f27e0-ab32-42fc-a274-3cfb5b908f0d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:03.013543 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9f6f27e0-ab32-42fc-a274-3cfb5b908f0d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:03.014001 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9f6f27e0-ab32-42fc-a274-3cfb5b908f0d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:03.046464 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-86370776-1081-4756-bbf8-d8dbbd4966a8 None None] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.337942 Feb 04 18:01:03.050639 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 20/39] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:01:03.062707 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-39f353ee-7fe3-4d8c-8c6d-86001b659e63 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:03.072331 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-39f353ee-7fe3-4d8c-8c6d-86001b659e63 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:03.140477 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-39f353ee-7fe3-4d8c-8c6d-86001b659e63 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:03.144156 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-39f353ee-7fe3-4d8c-8c6d-86001b659e63 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:03.145838 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-39f353ee-7fe3-4d8c-8c6d-86001b659e63 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:03.147817 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-39f353ee-7fe3-4d8c-8c6d-86001b659e63 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:03.523805 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-39f353ee-7fe3-4d8c-8c6d-86001b659e63 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:03.548925 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-39f353ee-7fe3-4d8c-8c6d-86001b659e63 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1226 microversion: 2.1 time: 0.494390 Feb 04 18:01:03.552568 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 21/40] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:03 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1226 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:03.677848 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-5eedfb0b-a707-4baa-bae3-72c05b6bcfcf tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:03.677848 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-5eedfb0b-a707-4baa-bae3-72c05b6bcfcf tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:03.681183 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5eedfb0b-a707-4baa-bae3-72c05b6bcfcf tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:03.681333 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5eedfb0b-a707-4baa-bae3-72c05b6bcfcf tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:03.685424 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5eedfb0b-a707-4baa-bae3-72c05b6bcfcf tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:03.685908 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5eedfb0b-a707-4baa-bae3-72c05b6bcfcf tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:03.928097 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-9f6f27e0-ab32-42fc-a274-3cfb5b908f0d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:03.938699 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-9f6f27e0-ab32-42fc-a274-3cfb5b908f0d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.980256 Feb 04 18:01:03.939585 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 20/41] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:02 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:04.023500 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5eedfb0b-a707-4baa-bae3-72c05b6bcfcf tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:04.032038 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-5eedfb0b-a707-4baa-bae3-72c05b6bcfcf tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.383190 Feb 04 18:01:04.032820 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 22/42] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:03 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:04.321580 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-d598f8dd-5400-4894-9e09-7540bb167c3c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1468704046", "imageRef": "b0fb57f5-967d-4692-94f3-accee37910c3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0bab5cdf-34a8-435a-8e36-431b0f11e511"}], "security_groups": [{"name": "tempest-securitygroup--107471419"}], "key_name": "tempest-keypair-2139143506", "user_data": "}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:01:04.480338 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.network.neutron [None req-d598f8dd-5400-4894-9e09-7540bb167c3c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] validate_networks() for [('0bab5cdf-34a8-435a-8e36-431b0f11e511', None, None, None, None, None)] {{(pid=123566) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 04 18:01:04.569464 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-bb36dae4-1146-43f5-ba58-dd833441e4a1 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:04.570516 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-bb36dae4-1146-43f5-ba58-dd833441e4a1 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:04.577759 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bb36dae4-1146-43f5-ba58-dd833441e4a1 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:04.578507 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bb36dae4-1146-43f5-ba58-dd833441e4a1 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:04.579481 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bb36dae4-1146-43f5-ba58-dd833441e4a1 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:04.580067 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bb36dae4-1146-43f5-ba58-dd833441e4a1 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:04.671785 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-bb36dae4-1146-43f5-ba58-dd833441e4a1 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:04.684015 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-bb36dae4-1146-43f5-ba58-dd833441e4a1 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1218 microversion: 2.1 time: 0.121068 Feb 04 18:01:04.684762 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 23/43] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:04 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1218 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:04.955520 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-859800f4-d4bf-4864-9d17-e1f24f669c6b tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:04.956189 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-859800f4-d4bf-4864-9d17-e1f24f669c6b tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:04.962916 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-859800f4-d4bf-4864-9d17-e1f24f669c6b tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:04.963372 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-859800f4-d4bf-4864-9d17-e1f24f669c6b tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:04.964577 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-859800f4-d4bf-4864-9d17-e1f24f669c6b tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:04.966585 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-859800f4-d4bf-4864-9d17-e1f24f669c6b tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:05.305931 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-d598f8dd-5400-4894-9e09-7540bb167c3c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Flavor limits 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 04 18:01:05.307650 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-d598f8dd-5400-4894-9e09-7540bb167c3c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Image limits 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 04 18:01:05.308353 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-d598f8dd-5400-4894-9e09-7540bb167c3c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Flavor pref 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 04 18:01:05.309122 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-d598f8dd-5400-4894-9e09-7540bb167c3c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Image pref 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 04 18:01:05.309793 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-d598f8dd-5400-4894-9e09-7540bb167c3c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 04 18:01:05.330946 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d598f8dd-5400-4894-9e09-7540bb167c3c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:05.331528 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d598f8dd-5400-4894-9e09-7540bb167c3c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:05.340706 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d598f8dd-5400-4894-9e09-7540bb167c3c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:05.341509 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d598f8dd-5400-4894-9e09-7540bb167c3c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:05.378346 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-d598f8dd-5400-4894-9e09-7540bb167c3c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Getting quotas for project 745beddd0c154d82a7e95298706587b1. Resources: {'cores', 'ram', 'instances'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:01:05.387460 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-d598f8dd-5400-4894-9e09-7540bb167c3c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Getting quotas for user 74e23ced236b429c8aab135f45fe3e01 and project 745beddd0c154d82a7e95298706587b1. Resources: {'cores', 'ram', 'instances'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:01:05.415127 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-d598f8dd-5400-4894-9e09-7540bb167c3c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Going to run 1 instances... {{(pid=123566) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 04 18:01:05.420291 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-d598f8dd-5400-4894-9e09-7540bb167c3c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0fb57f5-967d-4692-94f3-accee37910c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 04 18:01:05.442828 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-859800f4-d4bf-4864-9d17-e1f24f669c6b tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:05.451982 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-859800f4-d4bf-4864-9d17-e1f24f669c6b tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.500013 Feb 04 18:01:05.452590 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 24/44] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:04 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:05.463953 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-551d3b08-f87a-4b52-881f-2849ba06debb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:05.487845 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-551d3b08-f87a-4b52-881f-2849ba06debb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:05.513601 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-551d3b08-f87a-4b52-881f-2849ba06debb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:05.514764 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-551d3b08-f87a-4b52-881f-2849ba06debb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:05.515807 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-551d3b08-f87a-4b52-881f-2849ba06debb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:05.517710 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-551d3b08-f87a-4b52-881f-2849ba06debb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:05.733456 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-d598f8dd-5400-4894-9e09-7540bb167c3c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.418039 Feb 04 18:01:05.744359 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 21/45] 10.222.0.98 () {62 vars in 1187 bytes} [Fri Feb 4 18:01:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 1432 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 04 18:01:05.764365 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-b16818d8-e0e4-4d39-a833-500fa43efce5 req-258d04a6-61a3-4e2c-a59f-b459740ffe07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac7788c2-1c60-4ef7-ae66-10e8d75a8807", "tag": "28ad9a9d-773a-41b6-b970-7a330131600a"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:01:05.796409 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:01:05.796409 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:01:05.877402 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-b16818d8-e0e4-4d39-a833-500fa43efce5 req-258d04a6-61a3-4e2c-a59f-b459740ffe07 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:05.878576 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-b16818d8-e0e4-4d39-a833-500fa43efce5 req-258d04a6-61a3-4e2c-a59f-b459740ffe07 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:05.937184 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-b16818d8-e0e4-4d39-a833-500fa43efce5 req-258d04a6-61a3-4e2c-a59f-b459740ffe07 service nova] Creating event network-changed:28ad9a9d-773a-41b6-b970-7a330131600a for instance ac7788c2-1c60-4ef7-ae66-10e8d75a8807 on hv-cinder-82276 Feb 04 18:01:05.937777 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-b16818d8-e0e4-4d39-a833-500fa43efce5 req-258d04a6-61a3-4e2c-a59f-b459740ffe07 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123566) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 04 18:01:05.938961 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ef640135-2305-4b23-b489-3cd78715faad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:05.939413 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ef640135-2305-4b23-b489-3cd78715faad None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:05.940269 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ef640135-2305-4b23-b489-3cd78715faad None None] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:05.940774 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ef640135-2305-4b23-b489-3cd78715faad None None] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:05.953769 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.compute.rpcapi [None req-ef640135-2305-4b23-b489-3cd78715faad None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Feb 04 18:01:05.953769 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ef640135-2305-4b23-b489-3cd78715faad None None] Releasing lock "compute-rpcapi-router" {{(pid=123566) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 04 18:01:05.994234 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ef640135-2305-4b23-b489-3cd78715faad None None] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.247422 Feb 04 18:01:05.995088 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 22/46] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:01:06.013869 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-08426045-df0c-46aa-b02c-161a39dc9f74 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:06.017152 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-08426045-df0c-46aa-b02c-161a39dc9f74 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:06.062394 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-08426045-df0c-46aa-b02c-161a39dc9f74 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:06.063539 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-08426045-df0c-46aa-b02c-161a39dc9f74 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:06.065131 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-08426045-df0c-46aa-b02c-161a39dc9f74 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:06.065984 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-08426045-df0c-46aa-b02c-161a39dc9f74 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:06.546906 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-08426045-df0c-46aa-b02c-161a39dc9f74 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:06.558978 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-08426045-df0c-46aa-b02c-161a39dc9f74 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1218 microversion: 2.1 time: 0.559673 Feb 04 18:01:06.558978 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 23/47] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:05 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1218 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:06.575454 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-8ef46cf3-80e4-4b75-8c7d-2d3d206d6a45 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:06.577477 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-8ef46cf3-80e4-4b75-8c7d-2d3d206d6a45 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:06.682455 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-551d3b08-f87a-4b52-881f-2849ba06debb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:06.691455 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-551d3b08-f87a-4b52-881f-2849ba06debb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 1.231961 Feb 04 18:01:06.700378 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 25/48] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:05 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:06.718916 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-fda4c135-91a1-423f-b893-5293fd938971 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:06.724265 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-fda4c135-91a1-423f-b893-5293fd938971 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:06.737976 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fda4c135-91a1-423f-b893-5293fd938971 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:06.738468 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fda4c135-91a1-423f-b893-5293fd938971 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:06.739302 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fda4c135-91a1-423f-b893-5293fd938971 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:06.745973 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fda4c135-91a1-423f-b893-5293fd938971 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:06.865520 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-8ef46cf3-80e4-4b75-8c7d-2d3d206d6a45 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:06.874221 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-8ef46cf3-80e4-4b75-8c7d-2d3d206d6a45 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:06.876365 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-8ef46cf3-80e4-4b75-8c7d-2d3d206d6a45 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:06.877863 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-8ef46cf3-80e4-4b75-8c7d-2d3d206d6a45 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1282 microversion: 2.20 time: 0.319630 Feb 04 18:01:06.879417 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 24/49] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:06 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1282 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:01:07.147783 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-fda4c135-91a1-423f-b893-5293fd938971 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:07.155916 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-fda4c135-91a1-423f-b893-5293fd938971 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.454525 Feb 04 18:01:07.156513 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 26/50] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:06 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:07.574076 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-c53d67e4-a300-4f79-a246-364d5f935d4f tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:07.574739 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-c53d67e4-a300-4f79-a246-364d5f935d4f tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:07.581123 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c53d67e4-a300-4f79-a246-364d5f935d4f tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:07.581584 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c53d67e4-a300-4f79-a246-364d5f935d4f tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:07.582376 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c53d67e4-a300-4f79-a246-364d5f935d4f tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:07.582846 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c53d67e4-a300-4f79-a246-364d5f935d4f tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:07.717091 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e5bf9e1b-ca3a-49f9-b236-ab91976f8826 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:07.717686 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-e5bf9e1b-ca3a-49f9-b236-ab91976f8826 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:07.728399 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e5bf9e1b-ca3a-49f9-b236-ab91976f8826 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:07.729005 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e5bf9e1b-ca3a-49f9-b236-ab91976f8826 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:07.730019 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e5bf9e1b-ca3a-49f9-b236-ab91976f8826 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:07.730876 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e5bf9e1b-ca3a-49f9-b236-ab91976f8826 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:07.816575 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c53d67e4-a300-4f79-a246-364d5f935d4f tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:07.824261 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-c53d67e4-a300-4f79-a246-364d5f935d4f tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1282 microversion: 2.1 time: 0.253699 Feb 04 18:01:07.825452 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 25/51] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:07 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1282 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:07.904014 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b84bcfb4-fde6-4244-83a9-bf6c91a8e2cb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:07.904703 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-b84bcfb4-fde6-4244-83a9-bf6c91a8e2cb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:07.910928 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b84bcfb4-fde6-4244-83a9-bf6c91a8e2cb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:07.911374 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b84bcfb4-fde6-4244-83a9-bf6c91a8e2cb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:07.912308 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b84bcfb4-fde6-4244-83a9-bf6c91a8e2cb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:07.912898 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b84bcfb4-fde6-4244-83a9-bf6c91a8e2cb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:07.925593 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e5bf9e1b-ca3a-49f9-b236-ab91976f8826 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:07.934955 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e5bf9e1b-ca3a-49f9-b236-ab91976f8826 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.221476 Feb 04 18:01:07.935693 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 27/52] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:07 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:07.975633 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-b84bcfb4-fde6-4244-83a9-bf6c91a8e2cb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:07.985500 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-b84bcfb4-fde6-4244-83a9-bf6c91a8e2cb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:07.987062 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-b84bcfb4-fde6-4244-83a9-bf6c91a8e2cb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:07.988187 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-b84bcfb4-fde6-4244-83a9-bf6c91a8e2cb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1286 microversion: 2.20 time: 0.088397 Feb 04 18:01:07.988802 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 26/53] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:07 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:01:08.172763 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-abc2452a-6ac6-4441-a74e-cc535ac7cfa7 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:08.173733 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-abc2452a-6ac6-4441-a74e-cc535ac7cfa7 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:08.181438 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-abc2452a-6ac6-4441-a74e-cc535ac7cfa7 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:08.181898 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-abc2452a-6ac6-4441-a74e-cc535ac7cfa7 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:08.182730 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-abc2452a-6ac6-4441-a74e-cc535ac7cfa7 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:08.183170 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-abc2452a-6ac6-4441-a74e-cc535ac7cfa7 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:08.352211 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-abc2452a-6ac6-4441-a74e-cc535ac7cfa7 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:08.359622 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-abc2452a-6ac6-4441-a74e-cc535ac7cfa7 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.190596 Feb 04 18:01:08.369722 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 28/54] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:08 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:08.843557 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-de35a983-1a5f-498a-9c04-a22b7c3cee44 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:08.849314 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-de35a983-1a5f-498a-9c04-a22b7c3cee44 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:08.850668 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-de35a983-1a5f-498a-9c04-a22b7c3cee44 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:08.851131 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-de35a983-1a5f-498a-9c04-a22b7c3cee44 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:08.851932 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-de35a983-1a5f-498a-9c04-a22b7c3cee44 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:08.852378 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-de35a983-1a5f-498a-9c04-a22b7c3cee44 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:08.918492 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-de35a983-1a5f-498a-9c04-a22b7c3cee44 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:08.926242 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-de35a983-1a5f-498a-9c04-a22b7c3cee44 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1282 microversion: 2.1 time: 0.086418 Feb 04 18:01:08.927095 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 27/55] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:08 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1282 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:08.952089 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3c0f4f5b-77b2-40c2-8f1d-5a43b1d1fdd5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:08.952888 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-3c0f4f5b-77b2-40c2-8f1d-5a43b1d1fdd5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:08.959292 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3c0f4f5b-77b2-40c2-8f1d-5a43b1d1fdd5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:08.960822 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3c0f4f5b-77b2-40c2-8f1d-5a43b1d1fdd5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:08.961780 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3c0f4f5b-77b2-40c2-8f1d-5a43b1d1fdd5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:08.962301 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3c0f4f5b-77b2-40c2-8f1d-5a43b1d1fdd5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:09.007823 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-c710160f-0d02-46a6-8585-1849c19c4d5b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:09.008451 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-c710160f-0d02-46a6-8585-1849c19c4d5b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:09.015039 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c710160f-0d02-46a6-8585-1849c19c4d5b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:09.015503 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c710160f-0d02-46a6-8585-1849c19c4d5b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:09.016309 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c710160f-0d02-46a6-8585-1849c19c4d5b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:09.016754 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c710160f-0d02-46a6-8585-1849c19c4d5b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:09.092729 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c710160f-0d02-46a6-8585-1849c19c4d5b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:09.115756 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c710160f-0d02-46a6-8585-1849c19c4d5b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:09.118256 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c710160f-0d02-46a6-8585-1849c19c4d5b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:09.120199 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-c710160f-0d02-46a6-8585-1849c19c4d5b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1286 microversion: 2.20 time: 0.117558 Feb 04 18:01:09.121298 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 28/56] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:09 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1286 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:01:09.161150 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-3c0f4f5b-77b2-40c2-8f1d-5a43b1d1fdd5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:09.169162 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-3c0f4f5b-77b2-40c2-8f1d-5a43b1d1fdd5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.220633 Feb 04 18:01:09.169976 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 29/57] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:08 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:09.376298 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-c1fde75c-b09a-4620-bf8e-a536a1700c3d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:09.376909 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-c1fde75c-b09a-4620-bf8e-a536a1700c3d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:09.398320 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c1fde75c-b09a-4620-bf8e-a536a1700c3d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:09.398879 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c1fde75c-b09a-4620-bf8e-a536a1700c3d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:09.399685 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c1fde75c-b09a-4620-bf8e-a536a1700c3d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:09.400125 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c1fde75c-b09a-4620-bf8e-a536a1700c3d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:09.944492 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-356189a4-f246-4af9-8b66-5b54305c7214 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:09.948744 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-356189a4-f246-4af9-8b66-5b54305c7214 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:09.959128 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-356189a4-f246-4af9-8b66-5b54305c7214 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:09.959874 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-356189a4-f246-4af9-8b66-5b54305c7214 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:09.960314 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-356189a4-f246-4af9-8b66-5b54305c7214 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:09.960753 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-356189a4-f246-4af9-8b66-5b54305c7214 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:09.983178 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c1fde75c-b09a-4620-bf8e-a536a1700c3d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:09.992307 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-c1fde75c-b09a-4620-bf8e-a536a1700c3d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.619620 Feb 04 18:01:09.993066 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 29/58] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:09 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:10.055446 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-356189a4-f246-4af9-8b66-5b54305c7214 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:10.066849 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-356189a4-f246-4af9-8b66-5b54305c7214 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1280 microversion: 2.1 time: 0.126252 Feb 04 18:01:10.067669 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 30/59] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:09 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1280 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:10.153206 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-9c44a4f9-8716-49d8-ada4-264a27b85a13 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:10.154581 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-9c44a4f9-8716-49d8-ada4-264a27b85a13 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:10.164252 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9c44a4f9-8716-49d8-ada4-264a27b85a13 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:10.164706 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9c44a4f9-8716-49d8-ada4-264a27b85a13 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:10.166403 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9c44a4f9-8716-49d8-ada4-264a27b85a13 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:10.167463 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9c44a4f9-8716-49d8-ada4-264a27b85a13 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:10.188036 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3fee0f28-5637-4d56-924f-4180392c4b4d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:10.188895 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-3fee0f28-5637-4d56-924f-4180392c4b4d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:10.198710 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3fee0f28-5637-4d56-924f-4180392c4b4d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:10.200263 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3fee0f28-5637-4d56-924f-4180392c4b4d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:10.203060 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3fee0f28-5637-4d56-924f-4180392c4b4d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:10.203673 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3fee0f28-5637-4d56-924f-4180392c4b4d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:10.412466 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-9c44a4f9-8716-49d8-ada4-264a27b85a13 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:10.422661 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-9c44a4f9-8716-49d8-ada4-264a27b85a13 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:10.424795 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-9c44a4f9-8716-49d8-ada4-264a27b85a13 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:10.425949 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-9c44a4f9-8716-49d8-ada4-264a27b85a13 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1334 microversion: 2.20 time: 0.281735 Feb 04 18:01:10.426693 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 30/60] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:10 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1334 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:01:11.009728 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-bdc1d0cb-61a5-4659-8d94-a44ead94231d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:11.011298 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-bdc1d0cb-61a5-4659-8d94-a44ead94231d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:11.024746 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bdc1d0cb-61a5-4659-8d94-a44ead94231d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:11.025342 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bdc1d0cb-61a5-4659-8d94-a44ead94231d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:11.026741 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bdc1d0cb-61a5-4659-8d94-a44ead94231d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:11.027444 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bdc1d0cb-61a5-4659-8d94-a44ead94231d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:11.203921 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-3fee0f28-5637-4d56-924f-4180392c4b4d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:11.231638 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-3fee0f28-5637-4d56-924f-4180392c4b4d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 1.044302 Feb 04 18:01:11.234042 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 31/61] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:10 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:11.254488 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c9665535-8588-4b6f-9145-7f1695a1f563 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:11.255384 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c9665535-8588-4b6f-9145-7f1695a1f563 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:11.270779 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c9665535-8588-4b6f-9145-7f1695a1f563 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:11.272321 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c9665535-8588-4b6f-9145-7f1695a1f563 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:11.274387 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c9665535-8588-4b6f-9145-7f1695a1f563 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:11.275019 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c9665535-8588-4b6f-9145-7f1695a1f563 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:11.406327 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c9665535-8588-4b6f-9145-7f1695a1f563 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:11.419443 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c9665535-8588-4b6f-9145-7f1695a1f563 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1280 microversion: 2.1 time: 0.184143 Feb 04 18:01:11.421115 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 32/62] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:11 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1280 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:11.741208 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-bdc1d0cb-61a5-4659-8d94-a44ead94231d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:11.753696 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-bdc1d0cb-61a5-4659-8d94-a44ead94231d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.747983 Feb 04 18:01:11.755035 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 31/63] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:11 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:11.771302 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-eee54489-bd0b-4081-b988-3ab2fdfa26f5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:11.774498 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-eee54489-bd0b-4081-b988-3ab2fdfa26f5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:11.783018 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-eee54489-bd0b-4081-b988-3ab2fdfa26f5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:11.783925 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-eee54489-bd0b-4081-b988-3ab2fdfa26f5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:11.785836 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-eee54489-bd0b-4081-b988-3ab2fdfa26f5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:11.786292 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-eee54489-bd0b-4081-b988-3ab2fdfa26f5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:11.834032 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-94ff404c-22db-45b9-9606-9f33474a4038 req-886c34d6-44ca-4b23-94ab-73ca94918b95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16b81832-5021-4cd2-8ebf-767daeb17673", "tag": "448b92cf-8fd6-4137-a431-b26132b3bd03"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:01:11.836064 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:01:11.836064 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:01:11.852323 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-94ff404c-22db-45b9-9606-9f33474a4038 req-886c34d6-44ca-4b23-94ab-73ca94918b95 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:11.853663 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-94ff404c-22db-45b9-9606-9f33474a4038 req-886c34d6-44ca-4b23-94ab-73ca94918b95 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:11.888036 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-94ff404c-22db-45b9-9606-9f33474a4038 req-886c34d6-44ca-4b23-94ab-73ca94918b95 service nova] Creating event network-changed:448b92cf-8fd6-4137-a431-b26132b3bd03 for instance 16b81832-5021-4cd2-8ebf-767daeb17673 on hv-cinder-82276 Feb 04 18:01:11.891167 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-eee54489-bd0b-4081-b988-3ab2fdfa26f5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:11.912200 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-eee54489-bd0b-4081-b988-3ab2fdfa26f5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:11.915680 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-94ff404c-22db-45b9-9606-9f33474a4038 req-886c34d6-44ca-4b23-94ab-73ca94918b95 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.493107 Feb 04 18:01:11.918865 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-eee54489-bd0b-4081-b988-3ab2fdfa26f5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:11.921148 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 33/64] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:01:11.928123 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-eee54489-bd0b-4081-b988-3ab2fdfa26f5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1342 microversion: 2.20 time: 0.171338 Feb 04 18:01:11.935423 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 32/65] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:11 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1342 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:01:12.256503 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-8a6a9354-9d08-4f61-83e0-0b9903c97180 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:12.258002 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-8a6a9354-9d08-4f61-83e0-0b9903c97180 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:12.269280 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8a6a9354-9d08-4f61-83e0-0b9903c97180 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:12.273024 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8a6a9354-9d08-4f61-83e0-0b9903c97180 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:12.275791 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8a6a9354-9d08-4f61-83e0-0b9903c97180 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:12.276721 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8a6a9354-9d08-4f61-83e0-0b9903c97180 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:12.448133 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-163eb8a7-1591-4a8e-9d85-992b358bf8ff tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:12.448747 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-163eb8a7-1591-4a8e-9d85-992b358bf8ff tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:12.462079 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-163eb8a7-1591-4a8e-9d85-992b358bf8ff tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:12.462788 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-163eb8a7-1591-4a8e-9d85-992b358bf8ff tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:12.463936 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-163eb8a7-1591-4a8e-9d85-992b358bf8ff tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:12.464518 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-163eb8a7-1591-4a8e-9d85-992b358bf8ff tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:12.728880 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-8a6a9354-9d08-4f61-83e0-0b9903c97180 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:12.737998 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-8a6a9354-9d08-4f61-83e0-0b9903c97180 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.488448 Feb 04 18:01:12.740471 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 34/66] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:12 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:12.771426 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-1b2810f5-99d6-45e0-b3e4-d9ac2adaab50 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:12.776412 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-1b2810f5-99d6-45e0-b3e4-d9ac2adaab50 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:12.779910 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1b2810f5-99d6-45e0-b3e4-d9ac2adaab50 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:12.780794 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1b2810f5-99d6-45e0-b3e4-d9ac2adaab50 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:12.782166 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1b2810f5-99d6-45e0-b3e4-d9ac2adaab50 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:12.784475 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1b2810f5-99d6-45e0-b3e4-d9ac2adaab50 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:12.876863 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-163eb8a7-1591-4a8e-9d85-992b358bf8ff tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:12.889482 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-163eb8a7-1591-4a8e-9d85-992b358bf8ff tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1322 microversion: 2.1 time: 0.445060 Feb 04 18:01:12.890148 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 33/67] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:12 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1322 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:12.951914 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-6f61a7bc-9df8-4c48-be7a-bb22af8f9cfc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:12.962131 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-6f61a7bc-9df8-4c48-be7a-bb22af8f9cfc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:12.972184 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6f61a7bc-9df8-4c48-be7a-bb22af8f9cfc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:12.976402 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6f61a7bc-9df8-4c48-be7a-bb22af8f9cfc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:12.976402 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6f61a7bc-9df8-4c48-be7a-bb22af8f9cfc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:12.976402 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6f61a7bc-9df8-4c48-be7a-bb22af8f9cfc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:13.090595 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-6f61a7bc-9df8-4c48-be7a-bb22af8f9cfc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:13.094555 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-1b2810f5-99d6-45e0-b3e4-d9ac2adaab50 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:13.102148 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-1b2810f5-99d6-45e0-b3e4-d9ac2adaab50 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.335444 Feb 04 18:01:13.105502 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-6f61a7bc-9df8-4c48-be7a-bb22af8f9cfc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:13.110475 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 35/68] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:12 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:13.110593 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-6f61a7bc-9df8-4c48-be7a-bb22af8f9cfc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:13.110593 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-6f61a7bc-9df8-4c48-be7a-bb22af8f9cfc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1340 microversion: 2.20 time: 0.163546 Feb 04 18:01:13.123072 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 34/69] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:12 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1340 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:01:13.659610 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-382655d3-d5f6-4dd9-bebb-279ed2adb982 req-d94dcc85-ba37-4a0f-b236-adb8ee35d0da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "374b4453-744e-4cb1-a6f4-b8c4d48e3a5f", "tag": "5c15984f-de2a-4353-acb0-e4952295b2eb"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:01:13.662395 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:01:13.662395 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:01:13.675032 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-382655d3-d5f6-4dd9-bebb-279ed2adb982 req-d94dcc85-ba37-4a0f-b236-adb8ee35d0da service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:13.675478 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-382655d3-d5f6-4dd9-bebb-279ed2adb982 req-d94dcc85-ba37-4a0f-b236-adb8ee35d0da service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:13.690110 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-382655d3-d5f6-4dd9-bebb-279ed2adb982 req-d94dcc85-ba37-4a0f-b236-adb8ee35d0da service nova] Creating event network-changed:5c15984f-de2a-4353-acb0-e4952295b2eb for instance 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f on hv-cinder-82276 Feb 04 18:01:13.707050 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-382655d3-d5f6-4dd9-bebb-279ed2adb982 req-d94dcc85-ba37-4a0f-b236-adb8ee35d0da service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051308 Feb 04 18:01:13.713993 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 36/70] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:01:13.758698 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-f37e0502-31b8-435f-b976-c15e9ed60c5e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:13.759982 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-f37e0502-31b8-435f-b976-c15e9ed60c5e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:13.769994 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f37e0502-31b8-435f-b976-c15e9ed60c5e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:13.770933 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f37e0502-31b8-435f-b976-c15e9ed60c5e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:13.785368 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f37e0502-31b8-435f-b976-c15e9ed60c5e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:13.787881 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f37e0502-31b8-435f-b976-c15e9ed60c5e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:13.906771 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-dac2a36e-7c9a-455c-8800-acbb2e7e62e7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:13.907475 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-dac2a36e-7c9a-455c-8800-acbb2e7e62e7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:13.914016 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dac2a36e-7c9a-455c-8800-acbb2e7e62e7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:13.914821 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dac2a36e-7c9a-455c-8800-acbb2e7e62e7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:13.915839 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dac2a36e-7c9a-455c-8800-acbb2e7e62e7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:13.916476 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dac2a36e-7c9a-455c-8800-acbb2e7e62e7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:14.553466 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-f37e0502-31b8-435f-b976-c15e9ed60c5e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:14.560920 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-f37e0502-31b8-435f-b976-c15e9ed60c5e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.807044 Feb 04 18:01:14.561525 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 35/71] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:13 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:14.568807 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-277cb948-680d-457a-954e-1ac652c17385 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:14.579303 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-277cb948-680d-457a-954e-1ac652c17385 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:14.585830 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-277cb948-680d-457a-954e-1ac652c17385 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:14.586256 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-277cb948-680d-457a-954e-1ac652c17385 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:14.587084 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-277cb948-680d-457a-954e-1ac652c17385 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:14.587550 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-277cb948-680d-457a-954e-1ac652c17385 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:14.847724 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-dac2a36e-7c9a-455c-8800-acbb2e7e62e7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:14.857819 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-dac2a36e-7c9a-455c-8800-acbb2e7e62e7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1322 microversion: 2.1 time: 0.954948 Feb 04 18:01:14.860258 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 37/72] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:13 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1322 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:14.866945 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-2872b621-9ef7-47c2-b491-7450695a8538 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:14.867625 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-2872b621-9ef7-47c2-b491-7450695a8538 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:14.876249 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2872b621-9ef7-47c2-b491-7450695a8538 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:14.877148 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2872b621-9ef7-47c2-b491-7450695a8538 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:14.878511 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2872b621-9ef7-47c2-b491-7450695a8538 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:14.879135 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2872b621-9ef7-47c2-b491-7450695a8538 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:15.028445 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-277cb948-680d-457a-954e-1ac652c17385 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:15.036800 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-277cb948-680d-457a-954e-1ac652c17385 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.471957 Feb 04 18:01:15.037795 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 36/73] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:14 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:15.042401 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-efe505c8-26ca-42c5-9048-fb2005231cde req-2795155a-2660-4808-9c19-37578c371d73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "514ca883-72d2-4695-a4b6-47c18ce4add5", "tag": "fe3cfe16-c9c7-4dcd-a6bf-b32b9ba77df0"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:01:15.044298 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:01:15.044298 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:01:15.051888 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-efe505c8-26ca-42c5-9048-fb2005231cde req-2795155a-2660-4808-9c19-37578c371d73 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:15.052533 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-efe505c8-26ca-42c5-9048-fb2005231cde req-2795155a-2660-4808-9c19-37578c371d73 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:15.063878 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-efe505c8-26ca-42c5-9048-fb2005231cde req-2795155a-2660-4808-9c19-37578c371d73 service nova] Creating event network-changed:fe3cfe16-c9c7-4dcd-a6bf-b32b9ba77df0 for instance 514ca883-72d2-4695-a4b6-47c18ce4add5 on hv-cinder-82276 Feb 04 18:01:15.069735 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-efe505c8-26ca-42c5-9048-fb2005231cde req-2795155a-2660-4808-9c19-37578c371d73 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030554 Feb 04 18:01:15.070674 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 37/74] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:01:15.239557 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-2872b621-9ef7-47c2-b491-7450695a8538 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:15.252269 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-2872b621-9ef7-47c2-b491-7450695a8538 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:15.254212 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-2872b621-9ef7-47c2-b491-7450695a8538 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:15.255818 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-2872b621-9ef7-47c2-b491-7450695a8538 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1407 microversion: 2.20 time: 0.393133 Feb 04 18:01:15.256605 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 38/75] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:14 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1407 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:01:15.580834 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-938e3b49-2268-4421-9212-ff019d57a7b1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:15.581614 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-938e3b49-2268-4421-9212-ff019d57a7b1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:15.588023 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-938e3b49-2268-4421-9212-ff019d57a7b1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:15.588787 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-938e3b49-2268-4421-9212-ff019d57a7b1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:15.590032 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-938e3b49-2268-4421-9212-ff019d57a7b1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:15.590726 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-938e3b49-2268-4421-9212-ff019d57a7b1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:15.785294 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-938e3b49-2268-4421-9212-ff019d57a7b1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:15.794941 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-938e3b49-2268-4421-9212-ff019d57a7b1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.219077 Feb 04 18:01:15.804045 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 38/76] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:15 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:15.877680 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-dd8e4caf-4d76-4856-bb8f-d0665a4f331b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:15.878383 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-dd8e4caf-4d76-4856-bb8f-d0665a4f331b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:15.884437 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dd8e4caf-4d76-4856-bb8f-d0665a4f331b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:15.884994 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dd8e4caf-4d76-4856-bb8f-d0665a4f331b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:15.885727 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dd8e4caf-4d76-4856-bb8f-d0665a4f331b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:15.886165 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dd8e4caf-4d76-4856-bb8f-d0665a4f331b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:16.039528 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-dd8e4caf-4d76-4856-bb8f-d0665a4f331b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:16.047924 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-dd8e4caf-4d76-4856-bb8f-d0665a4f331b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1322 microversion: 2.1 time: 0.173514 Feb 04 18:01:16.047924 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 39/77] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:15 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:16.052879 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ca5537e9-57e8-4cee-b6c5-19ef3be92127 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:16.054121 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ca5537e9-57e8-4cee-b6c5-19ef3be92127 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:16.060525 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ca5537e9-57e8-4cee-b6c5-19ef3be92127 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:16.060976 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ca5537e9-57e8-4cee-b6c5-19ef3be92127 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:16.061763 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ca5537e9-57e8-4cee-b6c5-19ef3be92127 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:16.062196 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ca5537e9-57e8-4cee-b6c5-19ef3be92127 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:16.213079 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-ca5537e9-57e8-4cee-b6c5-19ef3be92127 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:16.220507 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ca5537e9-57e8-4cee-b6c5-19ef3be92127 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.171317 Feb 04 18:01:16.221118 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 39/78] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:16 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:16.273473 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-135cf001-4d54-4c9e-bc7b-9c84e5e2ba3b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:16.274223 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-135cf001-4d54-4c9e-bc7b-9c84e5e2ba3b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:16.280192 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-135cf001-4d54-4c9e-bc7b-9c84e5e2ba3b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:16.280677 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-135cf001-4d54-4c9e-bc7b-9c84e5e2ba3b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:16.281444 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-135cf001-4d54-4c9e-bc7b-9c84e5e2ba3b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:16.286529 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-135cf001-4d54-4c9e-bc7b-9c84e5e2ba3b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:16.465176 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-135cf001-4d54-4c9e-bc7b-9c84e5e2ba3b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:16.474292 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-135cf001-4d54-4c9e-bc7b-9c84e5e2ba3b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:16.494524 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-135cf001-4d54-4c9e-bc7b-9c84e5e2ba3b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:16.495694 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-135cf001-4d54-4c9e-bc7b-9c84e5e2ba3b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1407 microversion: 2.20 time: 0.226076 Feb 04 18:01:16.496273 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 40/79] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:16 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:01:16.811642 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-6c5b88c9-266f-453f-88b5-d970308b5453 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:16.812286 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-6c5b88c9-266f-453f-88b5-d970308b5453 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:16.818492 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6c5b88c9-266f-453f-88b5-d970308b5453 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:16.818944 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6c5b88c9-266f-453f-88b5-d970308b5453 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:16.819723 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6c5b88c9-266f-453f-88b5-d970308b5453 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:16.820156 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6c5b88c9-266f-453f-88b5-d970308b5453 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:17.026279 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-6c5b88c9-266f-453f-88b5-d970308b5453 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:17.036030 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-6c5b88c9-266f-453f-88b5-d970308b5453 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.228017 Feb 04 18:01:17.039625 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 40/80] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:16 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:17.063716 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-cfa591e9-3ad6-47b6-a1ec-df05af692d65 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:17.064986 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-cfa591e9-3ad6-47b6-a1ec-df05af692d65 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:17.071043 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cfa591e9-3ad6-47b6-a1ec-df05af692d65 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:17.071604 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cfa591e9-3ad6-47b6-a1ec-df05af692d65 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:17.072366 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cfa591e9-3ad6-47b6-a1ec-df05af692d65 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:17.073002 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cfa591e9-3ad6-47b6-a1ec-df05af692d65 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:17.243011 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-18be023f-f080-433d-932d-617d909ab21c tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:17.249453 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-18be023f-f080-433d-932d-617d909ab21c tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:17.267882 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-18be023f-f080-433d-932d-617d909ab21c tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:17.269041 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-18be023f-f080-433d-932d-617d909ab21c tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:17.270721 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-18be023f-f080-433d-932d-617d909ab21c tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:17.271972 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-18be023f-f080-433d-932d-617d909ab21c tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:17.309870 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-cfa591e9-3ad6-47b6-a1ec-df05af692d65 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:17.314405 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-cfa591e9-3ad6-47b6-a1ec-df05af692d65 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1322 microversion: 2.1 time: 0.254405 Feb 04 18:01:17.316315 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 41/81] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:17 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:17.457889 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-18be023f-f080-433d-932d-617d909ab21c tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:17.467531 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-18be023f-f080-433d-932d-617d909ab21c tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.233758 Feb 04 18:01:17.468184 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 41/82] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:17 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:17.514843 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-def17050-bdb6-4ee7-998f-1ff7a4b47d81 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:17.515463 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-def17050-bdb6-4ee7-998f-1ff7a4b47d81 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:17.521950 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-def17050-bdb6-4ee7-998f-1ff7a4b47d81 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:17.522438 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-def17050-bdb6-4ee7-998f-1ff7a4b47d81 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:17.523249 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-def17050-bdb6-4ee7-998f-1ff7a4b47d81 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:17.523709 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-def17050-bdb6-4ee7-998f-1ff7a4b47d81 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:17.665500 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-def17050-bdb6-4ee7-998f-1ff7a4b47d81 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:17.676453 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-def17050-bdb6-4ee7-998f-1ff7a4b47d81 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:17.678131 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-def17050-bdb6-4ee7-998f-1ff7a4b47d81 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:17.679302 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-def17050-bdb6-4ee7-998f-1ff7a4b47d81 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1407 microversion: 2.20 time: 0.168491 Feb 04 18:01:17.680006 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 42/83] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:17 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:01:18.056236 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-df9fe361-44f9-47dd-b4f6-4ec7d499dd3d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:18.057140 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-df9fe361-44f9-47dd-b4f6-4ec7d499dd3d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:18.063816 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-df9fe361-44f9-47dd-b4f6-4ec7d499dd3d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:18.064306 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-df9fe361-44f9-47dd-b4f6-4ec7d499dd3d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:18.065191 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-df9fe361-44f9-47dd-b4f6-4ec7d499dd3d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:18.065633 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-df9fe361-44f9-47dd-b4f6-4ec7d499dd3d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:18.275021 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-df9fe361-44f9-47dd-b4f6-4ec7d499dd3d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:18.283736 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-df9fe361-44f9-47dd-b4f6-4ec7d499dd3d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.231784 Feb 04 18:01:18.293422 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 42/84] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:18 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:18.333332 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a1c654e2-27c9-483d-a140-87f21357c17b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:18.334063 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-a1c654e2-27c9-483d-a140-87f21357c17b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:18.340246 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a1c654e2-27c9-483d-a140-87f21357c17b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:18.340912 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a1c654e2-27c9-483d-a140-87f21357c17b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:18.341853 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a1c654e2-27c9-483d-a140-87f21357c17b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:18.342328 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a1c654e2-27c9-483d-a140-87f21357c17b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:18.485268 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-7204f1d3-1650-4e4d-9c4e-a0caf5514d18 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:18.485889 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-7204f1d3-1650-4e4d-9c4e-a0caf5514d18 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:18.493167 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7204f1d3-1650-4e4d-9c4e-a0caf5514d18 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:18.493608 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7204f1d3-1650-4e4d-9c4e-a0caf5514d18 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:18.494709 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7204f1d3-1650-4e4d-9c4e-a0caf5514d18 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:18.495143 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7204f1d3-1650-4e4d-9c4e-a0caf5514d18 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:18.506781 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-a1c654e2-27c9-483d-a140-87f21357c17b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:18.514704 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a1c654e2-27c9-483d-a140-87f21357c17b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1322 microversion: 2.1 time: 0.185769 Feb 04 18:01:18.515355 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 43/85] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:18 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:18.643014 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-7204f1d3-1650-4e4d-9c4e-a0caf5514d18 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:18.650227 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-7204f1d3-1650-4e4d-9c4e-a0caf5514d18 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.169070 Feb 04 18:01:18.660377 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 43/86] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:18 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:18.697155 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-5247abc1-1b74-4918-bdfc-2f05b4e95c3b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:18.697854 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-5247abc1-1b74-4918-bdfc-2f05b4e95c3b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:18.706184 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5247abc1-1b74-4918-bdfc-2f05b4e95c3b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:18.707787 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5247abc1-1b74-4918-bdfc-2f05b4e95c3b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:18.710544 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5247abc1-1b74-4918-bdfc-2f05b4e95c3b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:18.711002 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5247abc1-1b74-4918-bdfc-2f05b4e95c3b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:18.864832 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5247abc1-1b74-4918-bdfc-2f05b4e95c3b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:18.874382 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5247abc1-1b74-4918-bdfc-2f05b4e95c3b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:18.876327 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5247abc1-1b74-4918-bdfc-2f05b4e95c3b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:18.877593 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-5247abc1-1b74-4918-bdfc-2f05b4e95c3b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1407 microversion: 2.20 time: 0.184200 Feb 04 18:01:18.878238 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 44/87] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:18 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:01:19.303020 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-36ebd5e2-7c11-489b-8834-3370b1b54431 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:19.303020 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-36ebd5e2-7c11-489b-8834-3370b1b54431 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:19.307418 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-36ebd5e2-7c11-489b-8834-3370b1b54431 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:19.307952 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-36ebd5e2-7c11-489b-8834-3370b1b54431 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:19.308752 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-36ebd5e2-7c11-489b-8834-3370b1b54431 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:19.309217 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-36ebd5e2-7c11-489b-8834-3370b1b54431 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:19.457139 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-36ebd5e2-7c11-489b-8834-3370b1b54431 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:19.464359 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-36ebd5e2-7c11-489b-8834-3370b1b54431 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.167901 Feb 04 18:01:19.465709 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 44/88] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:19 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:19.531837 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-abb146a0-0ea9-43f2-8dd2-cf6741de1a31 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:19.532451 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-abb146a0-0ea9-43f2-8dd2-cf6741de1a31 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:19.539826 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-abb146a0-0ea9-43f2-8dd2-cf6741de1a31 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:19.540282 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-abb146a0-0ea9-43f2-8dd2-cf6741de1a31 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:19.541082 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-abb146a0-0ea9-43f2-8dd2-cf6741de1a31 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:19.541522 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-abb146a0-0ea9-43f2-8dd2-cf6741de1a31 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:19.670604 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-c6745635-e9e0-4190-bc05-95d88a8f2e66 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:19.671400 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-c6745635-e9e0-4190-bc05-95d88a8f2e66 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:19.680298 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c6745635-e9e0-4190-bc05-95d88a8f2e66 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:19.680979 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c6745635-e9e0-4190-bc05-95d88a8f2e66 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:19.682079 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c6745635-e9e0-4190-bc05-95d88a8f2e66 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:19.683254 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c6745635-e9e0-4190-bc05-95d88a8f2e66 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:19.691785 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-abb146a0-0ea9-43f2-8dd2-cf6741de1a31 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:19.703992 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-abb146a0-0ea9-43f2-8dd2-cf6741de1a31 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1322 microversion: 2.1 time: 0.175665 Feb 04 18:01:19.704564 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 45/89] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:19 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:19.850659 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c6745635-e9e0-4190-bc05-95d88a8f2e66 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:19.858570 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-c6745635-e9e0-4190-bc05-95d88a8f2e66 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.194192 Feb 04 18:01:19.868356 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 45/90] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:19 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:19.895888 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e26583b3-db26-4b75-9561-4c3b349077c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:19.896488 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-e26583b3-db26-4b75-9561-4c3b349077c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:19.902697 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e26583b3-db26-4b75-9561-4c3b349077c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:19.903140 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e26583b3-db26-4b75-9561-4c3b349077c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:19.903919 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e26583b3-db26-4b75-9561-4c3b349077c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:19.904608 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e26583b3-db26-4b75-9561-4c3b349077c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:20.037357 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e26583b3-db26-4b75-9561-4c3b349077c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:20.045104 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e26583b3-db26-4b75-9561-4c3b349077c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:20.046641 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e26583b3-db26-4b75-9561-4c3b349077c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:20.047738 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e26583b3-db26-4b75-9561-4c3b349077c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1407 microversion: 2.20 time: 0.156084 Feb 04 18:01:20.048304 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 46/91] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:19 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:01:20.482190 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-177e4d78-ee84-4674-be2a-12f0e712111e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:20.482921 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-177e4d78-ee84-4674-be2a-12f0e712111e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:20.488704 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-177e4d78-ee84-4674-be2a-12f0e712111e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:20.489161 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-177e4d78-ee84-4674-be2a-12f0e712111e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:20.489947 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-177e4d78-ee84-4674-be2a-12f0e712111e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:20.490390 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-177e4d78-ee84-4674-be2a-12f0e712111e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:20.631337 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-177e4d78-ee84-4674-be2a-12f0e712111e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:20.638617 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-177e4d78-ee84-4674-be2a-12f0e712111e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.160042 Feb 04 18:01:20.639485 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 46/92] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:20 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:20.721130 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-107951eb-fa5c-4efe-8fe1-5cfe7846137e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:20.721742 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-107951eb-fa5c-4efe-8fe1-5cfe7846137e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:20.727628 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-107951eb-fa5c-4efe-8fe1-5cfe7846137e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:20.728081 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-107951eb-fa5c-4efe-8fe1-5cfe7846137e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:20.728851 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-107951eb-fa5c-4efe-8fe1-5cfe7846137e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:20.729287 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-107951eb-fa5c-4efe-8fe1-5cfe7846137e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:20.875838 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-77f104a4-c55b-4da9-b8a6-00beb71b6c8e tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:20.876459 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-77f104a4-c55b-4da9-b8a6-00beb71b6c8e tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:20.878516 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-107951eb-fa5c-4efe-8fe1-5cfe7846137e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:20.883217 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-77f104a4-c55b-4da9-b8a6-00beb71b6c8e tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:20.883715 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-77f104a4-c55b-4da9-b8a6-00beb71b6c8e tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:20.884801 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-77f104a4-c55b-4da9-b8a6-00beb71b6c8e tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:20.884905 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-77f104a4-c55b-4da9-b8a6-00beb71b6c8e tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:20.895384 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-107951eb-fa5c-4efe-8fe1-5cfe7846137e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1322 microversion: 2.1 time: 0.177884 Feb 04 18:01:20.895982 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 47/93] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:20 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:21.027308 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-77f104a4-c55b-4da9-b8a6-00beb71b6c8e tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:21.034997 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-77f104a4-c55b-4da9-b8a6-00beb71b6c8e tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.162763 Feb 04 18:01:21.035602 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 47/94] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:20 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:21.065757 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-22a4543e-7602-491e-8b54-8bee3f0a9c86 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:21.066384 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-22a4543e-7602-491e-8b54-8bee3f0a9c86 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:21.072491 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-22a4543e-7602-491e-8b54-8bee3f0a9c86 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:21.072932 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-22a4543e-7602-491e-8b54-8bee3f0a9c86 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:21.073697 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-22a4543e-7602-491e-8b54-8bee3f0a9c86 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:21.074180 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-22a4543e-7602-491e-8b54-8bee3f0a9c86 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:21.225699 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-22a4543e-7602-491e-8b54-8bee3f0a9c86 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:21.235633 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-22a4543e-7602-491e-8b54-8bee3f0a9c86 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:21.237688 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-22a4543e-7602-491e-8b54-8bee3f0a9c86 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:21.238827 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-22a4543e-7602-491e-8b54-8bee3f0a9c86 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1407 microversion: 2.20 time: 0.177493 Feb 04 18:01:21.239385 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 48/95] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:21 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:01:21.655519 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-2b6e25c3-7cc3-434e-9d93-69bb5d4fd730 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:21.656137 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-2b6e25c3-7cc3-434e-9d93-69bb5d4fd730 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:21.662051 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2b6e25c3-7cc3-434e-9d93-69bb5d4fd730 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:21.662558 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2b6e25c3-7cc3-434e-9d93-69bb5d4fd730 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:21.663337 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2b6e25c3-7cc3-434e-9d93-69bb5d4fd730 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:21.663951 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2b6e25c3-7cc3-434e-9d93-69bb5d4fd730 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:21.800560 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2b6e25c3-7cc3-434e-9d93-69bb5d4fd730 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:21.807883 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-2b6e25c3-7cc3-434e-9d93-69bb5d4fd730 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.156061 Feb 04 18:01:21.808464 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 48/96] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:21 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:21.912260 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-34ec5276-cd50-4ac8-9684-53b1369fddb1 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:21.912872 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-34ec5276-cd50-4ac8-9684-53b1369fddb1 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:21.918781 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-34ec5276-cd50-4ac8-9684-53b1369fddb1 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:21.919290 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-34ec5276-cd50-4ac8-9684-53b1369fddb1 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:21.920077 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-34ec5276-cd50-4ac8-9684-53b1369fddb1 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:21.920520 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-34ec5276-cd50-4ac8-9684-53b1369fddb1 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:22.051737 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-fbc61878-a4e0-4046-bc9f-a32a9618583e tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:22.052353 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-fbc61878-a4e0-4046-bc9f-a32a9618583e tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:22.056560 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-34ec5276-cd50-4ac8-9684-53b1369fddb1 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:22.058098 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fbc61878-a4e0-4046-bc9f-a32a9618583e tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:22.058591 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fbc61878-a4e0-4046-bc9f-a32a9618583e tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:22.059375 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fbc61878-a4e0-4046-bc9f-a32a9618583e tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:22.059817 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fbc61878-a4e0-4046-bc9f-a32a9618583e tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:22.063889 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-34ec5276-cd50-4ac8-9684-53b1369fddb1 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1322 microversion: 2.1 time: 0.155397 Feb 04 18:01:22.065066 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 49/97] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:21 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:22.192989 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-fbc61878-a4e0-4046-bc9f-a32a9618583e tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:22.200305 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-fbc61878-a4e0-4046-bc9f-a32a9618583e tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.152381 Feb 04 18:01:22.200879 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 49/98] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:22 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:22.257495 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-4987ff0f-58f2-432c-aed0-291c23c6e8fc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:22.257495 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-4987ff0f-58f2-432c-aed0-291c23c6e8fc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:22.263308 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4987ff0f-58f2-432c-aed0-291c23c6e8fc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:22.263760 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4987ff0f-58f2-432c-aed0-291c23c6e8fc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:22.264523 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4987ff0f-58f2-432c-aed0-291c23c6e8fc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:22.264954 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4987ff0f-58f2-432c-aed0-291c23c6e8fc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:22.398198 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-4987ff0f-58f2-432c-aed0-291c23c6e8fc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:22.405933 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-4987ff0f-58f2-432c-aed0-291c23c6e8fc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:22.407469 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-4987ff0f-58f2-432c-aed0-291c23c6e8fc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:22.408570 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-4987ff0f-58f2-432c-aed0-291c23c6e8fc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1407 microversion: 2.20 time: 0.155380 Feb 04 18:01:22.409133 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 50/99] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:22 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:01:22.824813 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-2d259ba1-6eb7-4d32-af60-4fe09dfc4960 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:22.825337 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-2d259ba1-6eb7-4d32-af60-4fe09dfc4960 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:22.831974 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2d259ba1-6eb7-4d32-af60-4fe09dfc4960 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:22.832418 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2d259ba1-6eb7-4d32-af60-4fe09dfc4960 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:22.833189 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2d259ba1-6eb7-4d32-af60-4fe09dfc4960 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:22.833623 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2d259ba1-6eb7-4d32-af60-4fe09dfc4960 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:23.048496 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2d259ba1-6eb7-4d32-af60-4fe09dfc4960 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:23.056238 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-2d259ba1-6eb7-4d32-af60-4fe09dfc4960 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.235165 Feb 04 18:01:23.056800 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 50/100] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:22 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:23.081120 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-ef1a6fdf-5c91-485e-b213-b8980a07100b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:23.081700 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-ef1a6fdf-5c91-485e-b213-b8980a07100b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:23.087658 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ef1a6fdf-5c91-485e-b213-b8980a07100b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:23.088111 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ef1a6fdf-5c91-485e-b213-b8980a07100b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:23.088887 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ef1a6fdf-5c91-485e-b213-b8980a07100b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:23.089323 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ef1a6fdf-5c91-485e-b213-b8980a07100b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:23.216862 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-be445ce9-5e96-4f14-836f-11246892c415 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:23.217805 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-be445ce9-5e96-4f14-836f-11246892c415 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:23.223208 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ef1a6fdf-5c91-485e-b213-b8980a07100b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:23.224380 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-be445ce9-5e96-4f14-836f-11246892c415 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:23.224824 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-be445ce9-5e96-4f14-836f-11246892c415 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:23.225596 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-be445ce9-5e96-4f14-836f-11246892c415 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:23.226027 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-be445ce9-5e96-4f14-836f-11246892c415 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:23.230524 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-ef1a6fdf-5c91-485e-b213-b8980a07100b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1322 microversion: 2.1 time: 0.153237 Feb 04 18:01:23.231108 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 51/101] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:23 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:23.367130 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-be445ce9-5e96-4f14-836f-11246892c415 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:23.374283 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-be445ce9-5e96-4f14-836f-11246892c415 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.161074 Feb 04 18:01:23.374894 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 51/102] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:23 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:23.426184 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-325fa3ec-25f4-43d5-bcc0-3934d7bdf593 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:23.426929 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-325fa3ec-25f4-43d5-bcc0-3934d7bdf593 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:23.432869 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-325fa3ec-25f4-43d5-bcc0-3934d7bdf593 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:23.433316 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-325fa3ec-25f4-43d5-bcc0-3934d7bdf593 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:23.434155 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-325fa3ec-25f4-43d5-bcc0-3934d7bdf593 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:23.434618 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-325fa3ec-25f4-43d5-bcc0-3934d7bdf593 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:23.569631 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-325fa3ec-25f4-43d5-bcc0-3934d7bdf593 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:23.577594 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-325fa3ec-25f4-43d5-bcc0-3934d7bdf593 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:23.579150 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-325fa3ec-25f4-43d5-bcc0-3934d7bdf593 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:23.580943 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-325fa3ec-25f4-43d5-bcc0-3934d7bdf593 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1407 microversion: 2.20 time: 0.159072 Feb 04 18:01:23.581736 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 52/103] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:23 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:01:24.072381 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-bd0e30e7-be38-4da6-afb3-87ec3e0c8268 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:24.072991 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-bd0e30e7-be38-4da6-afb3-87ec3e0c8268 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:24.078905 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bd0e30e7-be38-4da6-afb3-87ec3e0c8268 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:24.079379 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bd0e30e7-be38-4da6-afb3-87ec3e0c8268 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:24.080141 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bd0e30e7-be38-4da6-afb3-87ec3e0c8268 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:24.080580 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bd0e30e7-be38-4da6-afb3-87ec3e0c8268 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:24.213589 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-bd0e30e7-be38-4da6-afb3-87ec3e0c8268 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:24.220864 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-bd0e30e7-be38-4da6-afb3-87ec3e0c8268 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.152097 Feb 04 18:01:24.221431 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 52/104] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:24 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:24.247098 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-08461803-37ef-4a57-9d11-8a5699c993c6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:24.247713 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-08461803-37ef-4a57-9d11-8a5699c993c6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:24.254218 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-08461803-37ef-4a57-9d11-8a5699c993c6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:24.254698 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-08461803-37ef-4a57-9d11-8a5699c993c6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:24.255479 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-08461803-37ef-4a57-9d11-8a5699c993c6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:24.255922 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-08461803-37ef-4a57-9d11-8a5699c993c6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:24.389979 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-08461803-37ef-4a57-9d11-8a5699c993c6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:24.391440 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-7ec4c47d-f941-41c6-a4ad-a92fefd3d936 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:24.392129 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-7ec4c47d-f941-41c6-a4ad-a92fefd3d936 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:24.398576 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7ec4c47d-f941-41c6-a4ad-a92fefd3d936 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:24.399099 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7ec4c47d-f941-41c6-a4ad-a92fefd3d936 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:24.399982 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7ec4c47d-f941-41c6-a4ad-a92fefd3d936 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:24.400481 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7ec4c47d-f941-41c6-a4ad-a92fefd3d936 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:24.407036 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-08461803-37ef-4a57-9d11-8a5699c993c6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1322 microversion: 2.1 time: 0.163234 Feb 04 18:01:24.407617 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 53/105] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:24 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:24.541131 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-7ec4c47d-f941-41c6-a4ad-a92fefd3d936 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:24.549007 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-7ec4c47d-f941-41c6-a4ad-a92fefd3d936 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.160747 Feb 04 18:01:24.549588 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 53/106] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:24 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:24.598952 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-99040f2e-26ad-4d8e-9b80-92e2ceb01d8a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:24.599553 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-99040f2e-26ad-4d8e-9b80-92e2ceb01d8a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:24.605275 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-99040f2e-26ad-4d8e-9b80-92e2ceb01d8a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:24.605716 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-99040f2e-26ad-4d8e-9b80-92e2ceb01d8a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:24.606500 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-99040f2e-26ad-4d8e-9b80-92e2ceb01d8a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:24.606931 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-99040f2e-26ad-4d8e-9b80-92e2ceb01d8a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:24.742178 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-99040f2e-26ad-4d8e-9b80-92e2ceb01d8a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:24.749810 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-99040f2e-26ad-4d8e-9b80-92e2ceb01d8a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:24.751329 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-99040f2e-26ad-4d8e-9b80-92e2ceb01d8a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:24.752413 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-99040f2e-26ad-4d8e-9b80-92e2ceb01d8a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1407 microversion: 2.20 time: 0.157682 Feb 04 18:01:24.752971 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 54/107] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:24 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:01:25.237374 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-3b624f76-f50c-4c43-81ed-28a1e33ef804 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:25.238031 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-3b624f76-f50c-4c43-81ed-28a1e33ef804 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:25.244278 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3b624f76-f50c-4c43-81ed-28a1e33ef804 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:25.244724 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3b624f76-f50c-4c43-81ed-28a1e33ef804 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:25.246964 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3b624f76-f50c-4c43-81ed-28a1e33ef804 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:25.246964 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3b624f76-f50c-4c43-81ed-28a1e33ef804 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:25.379995 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-3b624f76-f50c-4c43-81ed-28a1e33ef804 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:25.387405 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-3b624f76-f50c-4c43-81ed-28a1e33ef804 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.153633 Feb 04 18:01:25.387987 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 54/108] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:25 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:25.424164 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3d15e9ae-30d0-4dbf-8791-75072a27225b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:25.424786 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-3d15e9ae-30d0-4dbf-8791-75072a27225b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:25.430670 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3d15e9ae-30d0-4dbf-8791-75072a27225b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:25.431129 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3d15e9ae-30d0-4dbf-8791-75072a27225b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:25.431916 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3d15e9ae-30d0-4dbf-8791-75072a27225b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:25.432358 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3d15e9ae-30d0-4dbf-8791-75072a27225b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:25.568601 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-77cb6c8e-442e-4684-a839-ade3f268ce98 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:25.569209 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-77cb6c8e-442e-4684-a839-ade3f268ce98 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:25.569779 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-3d15e9ae-30d0-4dbf-8791-75072a27225b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:25.575449 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-77cb6c8e-442e-4684-a839-ade3f268ce98 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:25.575892 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-77cb6c8e-442e-4684-a839-ade3f268ce98 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:25.576660 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-77cb6c8e-442e-4684-a839-ade3f268ce98 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:25.577100 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-77cb6c8e-442e-4684-a839-ade3f268ce98 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:25.578030 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-3d15e9ae-30d0-4dbf-8791-75072a27225b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1322 microversion: 2.1 time: 0.157936 Feb 04 18:01:25.578947 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 55/109] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:25 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:25.714228 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-77cb6c8e-442e-4684-a839-ade3f268ce98 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:25.726191 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-77cb6c8e-442e-4684-a839-ade3f268ce98 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.161240 Feb 04 18:01:25.726793 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 55/110] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:25 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:25.770778 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3abbfba6-7107-4ca8-bc32-570cfad92394 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:25.771314 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-3abbfba6-7107-4ca8-bc32-570cfad92394 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:25.777207 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3abbfba6-7107-4ca8-bc32-570cfad92394 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:25.777692 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3abbfba6-7107-4ca8-bc32-570cfad92394 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:25.778486 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3abbfba6-7107-4ca8-bc32-570cfad92394 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:25.778926 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3abbfba6-7107-4ca8-bc32-570cfad92394 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:25.920199 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-3abbfba6-7107-4ca8-bc32-570cfad92394 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:25.928309 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-3abbfba6-7107-4ca8-bc32-570cfad92394 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:25.929846 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-3abbfba6-7107-4ca8-bc32-570cfad92394 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:25.930994 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-3abbfba6-7107-4ca8-bc32-570cfad92394 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1407 microversion: 2.20 time: 0.164637 Feb 04 18:01:25.931561 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 56/111] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:25 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:01:26.405940 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-02663995-99f5-4631-a48f-2dd2d7f0069b tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:26.412067 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-02663995-99f5-4631-a48f-2dd2d7f0069b tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:26.416738 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-02663995-99f5-4631-a48f-2dd2d7f0069b tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:26.417229 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-02663995-99f5-4631-a48f-2dd2d7f0069b tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:26.418087 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-02663995-99f5-4631-a48f-2dd2d7f0069b tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:26.418563 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-02663995-99f5-4631-a48f-2dd2d7f0069b tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:26.606716 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c3f80162-3e16-41a3-bb9b-6a6328fb3a4a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:26.606716 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c3f80162-3e16-41a3-bb9b-6a6328fb3a4a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:26.606716 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c3f80162-3e16-41a3-bb9b-6a6328fb3a4a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:26.606716 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c3f80162-3e16-41a3-bb9b-6a6328fb3a4a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:26.607757 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c3f80162-3e16-41a3-bb9b-6a6328fb3a4a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:26.607757 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c3f80162-3e16-41a3-bb9b-6a6328fb3a4a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:26.955767 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-02663995-99f5-4631-a48f-2dd2d7f0069b tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:26.959217 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c3f80162-3e16-41a3-bb9b-6a6328fb3a4a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:26.964100 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-02663995-99f5-4631-a48f-2dd2d7f0069b tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.562977 Feb 04 18:01:26.965414 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 56/112] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:26 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:26.974523 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c3f80162-3e16-41a3-bb9b-6a6328fb3a4a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1322 microversion: 2.1 time: 0.374048 Feb 04 18:01:26.974523 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 57/113] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:26 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1322 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:26.974523 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-cd252703-d240-4cd7-94f9-0ec57dcfca46 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:26.974523 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-cd252703-d240-4cd7-94f9-0ec57dcfca46 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:26.978186 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-f9c3deb2-0d5d-447f-987c-d57846e60eab tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:26.978500 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cd252703-d240-4cd7-94f9-0ec57dcfca46 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:26.978955 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cd252703-d240-4cd7-94f9-0ec57dcfca46 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:26.979048 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-f9c3deb2-0d5d-447f-987c-d57846e60eab tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:26.979746 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cd252703-d240-4cd7-94f9-0ec57dcfca46 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:26.980187 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cd252703-d240-4cd7-94f9-0ec57dcfca46 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:26.985519 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f9c3deb2-0d5d-447f-987c-d57846e60eab tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:26.986668 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f9c3deb2-0d5d-447f-987c-d57846e60eab tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:26.994530 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f9c3deb2-0d5d-447f-987c-d57846e60eab tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:26.994530 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f9c3deb2-0d5d-447f-987c-d57846e60eab tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:27.188680 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-f9c3deb2-0d5d-447f-987c-d57846e60eab tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:27.196304 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-f9c3deb2-0d5d-447f-987c-d57846e60eab tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.229770 Feb 04 18:01:27.196894 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 57/114] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:26 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:27.200492 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-cd252703-d240-4cd7-94f9-0ec57dcfca46 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:27.209142 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-cd252703-d240-4cd7-94f9-0ec57dcfca46 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:27.210724 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-cd252703-d240-4cd7-94f9-0ec57dcfca46 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:27.211817 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-cd252703-d240-4cd7-94f9-0ec57dcfca46 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1407 microversion: 2.20 time: 0.243695 Feb 04 18:01:27.212380 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 58/115] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:26 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:01:27.980830 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-1d604369-6f95-4512-8b85-e62c405f3a42 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:27.981532 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-1d604369-6f95-4512-8b85-e62c405f3a42 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:27.983379 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-91365eee-301d-486d-87b0-d70ae1cbed99 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:27.983982 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-91365eee-301d-486d-87b0-d70ae1cbed99 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:27.988962 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1d604369-6f95-4512-8b85-e62c405f3a42 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:27.989591 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1d604369-6f95-4512-8b85-e62c405f3a42 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:27.990396 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1d604369-6f95-4512-8b85-e62c405f3a42 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:27.991202 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1d604369-6f95-4512-8b85-e62c405f3a42 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:27.991887 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-91365eee-301d-486d-87b0-d70ae1cbed99 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:27.992333 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-91365eee-301d-486d-87b0-d70ae1cbed99 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:27.993274 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-91365eee-301d-486d-87b0-d70ae1cbed99 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:27.993703 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-91365eee-301d-486d-87b0-d70ae1cbed99 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:28.203679 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-1d604369-6f95-4512-8b85-e62c405f3a42 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:28.207388 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-1d604369-6f95-4512-8b85-e62c405f3a42 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.230221 Feb 04 18:01:28.208859 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 58/116] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:27 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:28.210955 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-91365eee-301d-486d-87b0-d70ae1cbed99 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:28.214325 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-f781dc5d-b637-4fbe-b4a3-b5fc3e88fb1e tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:28.215396 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-f781dc5d-b637-4fbe-b4a3-b5fc3e88fb1e tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:28.219395 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-91365eee-301d-486d-87b0-d70ae1cbed99 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1322 microversion: 2.1 time: 0.239481 Feb 04 18:01:28.219999 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 59/117] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:27 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:28.222695 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f781dc5d-b637-4fbe-b4a3-b5fc3e88fb1e tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:28.223145 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f781dc5d-b637-4fbe-b4a3-b5fc3e88fb1e tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:28.223991 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f781dc5d-b637-4fbe-b4a3-b5fc3e88fb1e tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:28.224565 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f781dc5d-b637-4fbe-b4a3-b5fc3e88fb1e tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:28.233501 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c03c8abb-04a4-4141-b3b3-a7e29be0a6ae tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:28.234707 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c03c8abb-04a4-4141-b3b3-a7e29be0a6ae tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:28.242717 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c03c8abb-04a4-4141-b3b3-a7e29be0a6ae tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:28.243188 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c03c8abb-04a4-4141-b3b3-a7e29be0a6ae tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:28.243970 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c03c8abb-04a4-4141-b3b3-a7e29be0a6ae tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:28.244633 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c03c8abb-04a4-4141-b3b3-a7e29be0a6ae tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:28.441815 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-f781dc5d-b637-4fbe-b4a3-b5fc3e88fb1e tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:28.446510 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c03c8abb-04a4-4141-b3b3-a7e29be0a6ae tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:28.451215 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-f781dc5d-b637-4fbe-b4a3-b5fc3e88fb1e tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.240872 Feb 04 18:01:28.461860 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c03c8abb-04a4-4141-b3b3-a7e29be0a6ae tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:28.462859 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c03c8abb-04a4-4141-b3b3-a7e29be0a6ae tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:28.463730 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c03c8abb-04a4-4141-b3b3-a7e29be0a6ae tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1407 microversion: 2.20 time: 0.236760 Feb 04 18:01:28.463944 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 59/118] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:28 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:28.464478 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 60/119] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:28 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:01:29.224976 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-950b4a04-7ff7-4388-8c13-ec37ac1d1057 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:29.225585 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-950b4a04-7ff7-4388-8c13-ec37ac1d1057 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:29.231892 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-950b4a04-7ff7-4388-8c13-ec37ac1d1057 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:29.232342 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-950b4a04-7ff7-4388-8c13-ec37ac1d1057 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:29.233266 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-950b4a04-7ff7-4388-8c13-ec37ac1d1057 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:29.233697 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-950b4a04-7ff7-4388-8c13-ec37ac1d1057 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:29.237251 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-61adaef9-6ea1-40ca-b2b1-c448fb772440 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:29.237856 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-61adaef9-6ea1-40ca-b2b1-c448fb772440 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:29.244838 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-61adaef9-6ea1-40ca-b2b1-c448fb772440 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:29.245283 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-61adaef9-6ea1-40ca-b2b1-c448fb772440 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:29.246065 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-61adaef9-6ea1-40ca-b2b1-c448fb772440 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:29.246515 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-61adaef9-6ea1-40ca-b2b1-c448fb772440 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:29.476371 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-61adaef9-6ea1-40ca-b2b1-c448fb772440 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:29.477930 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-950b4a04-7ff7-4388-8c13-ec37ac1d1057 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:29.489074 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-61adaef9-6ea1-40ca-b2b1-c448fb772440 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1322 microversion: 2.1 time: 0.256120 Feb 04 18:01:29.491626 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 61/120] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:29 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:29.492989 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-950b4a04-7ff7-4388-8c13-ec37ac1d1057 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.271319 Feb 04 18:01:29.493716 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 60/121] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:29 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:29.498689 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-d70c34e7-9200-40f2-9fd2-d94004ef33cc tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:29.499564 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-d70c34e7-9200-40f2-9fd2-d94004ef33cc tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:29.516108 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d70c34e7-9200-40f2-9fd2-d94004ef33cc tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:29.516631 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d70c34e7-9200-40f2-9fd2-d94004ef33cc tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:29.517404 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d70c34e7-9200-40f2-9fd2-d94004ef33cc tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:29.517849 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d70c34e7-9200-40f2-9fd2-d94004ef33cc tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:29.649874 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-0bde0502-d002-4896-8b65-589d416a2806 req-22a1a0b9-4824-4f16-899d-2d52bb29e06b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac7788c2-1c60-4ef7-ae66-10e8d75a8807", "name": "network-vif-plugged", "status": "completed", "tag": "28ad9a9d-773a-41b6-b970-7a330131600a"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:01:29.651588 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:01:29.651588 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:01:29.659433 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-0bde0502-d002-4896-8b65-589d416a2806 req-22a1a0b9-4824-4f16-899d-2d52bb29e06b service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:29.659880 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-0bde0502-d002-4896-8b65-589d416a2806 req-22a1a0b9-4824-4f16-899d-2d52bb29e06b service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:29.671351 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-0bde0502-d002-4896-8b65-589d416a2806 req-22a1a0b9-4824-4f16-899d-2d52bb29e06b service nova] Creating event network-vif-plugged:28ad9a9d-773a-41b6-b970-7a330131600a for instance ac7788c2-1c60-4ef7-ae66-10e8d75a8807 on hv-cinder-82276 Feb 04 18:01:29.677426 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-0bde0502-d002-4896-8b65-589d416a2806 req-22a1a0b9-4824-4f16-899d-2d52bb29e06b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185749 Feb 04 18:01:29.678317 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 62/122] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:01:29.684532 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-d70c34e7-9200-40f2-9fd2-d94004ef33cc tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:29.689634 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-2700ec83-4029-420e-bc96-7f8e9965b3d6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:29.691189 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-2700ec83-4029-420e-bc96-7f8e9965b3d6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:29.693005 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-d70c34e7-9200-40f2-9fd2-d94004ef33cc tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.197820 Feb 04 18:01:29.698359 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 61/123] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:29 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:29.705105 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2700ec83-4029-420e-bc96-7f8e9965b3d6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:29.705742 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2700ec83-4029-420e-bc96-7f8e9965b3d6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:29.707482 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2700ec83-4029-420e-bc96-7f8e9965b3d6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:29.708113 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2700ec83-4029-420e-bc96-7f8e9965b3d6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:29.926140 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-2700ec83-4029-420e-bc96-7f8e9965b3d6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:29.935308 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-2700ec83-4029-420e-bc96-7f8e9965b3d6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:29.937920 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-2700ec83-4029-420e-bc96-7f8e9965b3d6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:29.938131 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-2700ec83-4029-420e-bc96-7f8e9965b3d6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1407 microversion: 2.20 time: 0.258718 Feb 04 18:01:29.939084 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 63/124] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:29 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:01:30.506709 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-545b8e18-fc52-4c9b-9cad-d96655782e36 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:30.507246 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-545b8e18-fc52-4c9b-9cad-d96655782e36 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:30.513694 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-545b8e18-fc52-4c9b-9cad-d96655782e36 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:30.514149 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-545b8e18-fc52-4c9b-9cad-d96655782e36 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:30.514977 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-545b8e18-fc52-4c9b-9cad-d96655782e36 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:30.515418 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-545b8e18-fc52-4c9b-9cad-d96655782e36 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:30.518813 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b2c622b4-8ad9-4287-afce-f7736622a73d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:30.519516 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-b2c622b4-8ad9-4287-afce-f7736622a73d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:30.525652 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b2c622b4-8ad9-4287-afce-f7736622a73d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:30.526156 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b2c622b4-8ad9-4287-afce-f7736622a73d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:30.526976 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b2c622b4-8ad9-4287-afce-f7736622a73d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:30.527414 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b2c622b4-8ad9-4287-afce-f7736622a73d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:30.717545 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-545b8e18-fc52-4c9b-9cad-d96655782e36 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:30.727072 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-545b8e18-fc52-4c9b-9cad-d96655782e36 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1322 microversion: 2.1 time: 0.222960 Feb 04 18:01:30.727072 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 62/125] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:30 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:30.727386 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-b2c622b4-8ad9-4287-afce-f7736622a73d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:30.733724 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-5ebaab83-b58f-43a4-a0f3-29e27eb6674c tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:30.734645 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-5ebaab83-b58f-43a4-a0f3-29e27eb6674c tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:30.745774 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5ebaab83-b58f-43a4-a0f3-29e27eb6674c tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:30.745774 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5ebaab83-b58f-43a4-a0f3-29e27eb6674c tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:30.745774 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5ebaab83-b58f-43a4-a0f3-29e27eb6674c tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:30.745774 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5ebaab83-b58f-43a4-a0f3-29e27eb6674c tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:30.753589 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b2c622b4-8ad9-4287-afce-f7736622a73d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.239311 Feb 04 18:01:30.755867 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 64/126] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:30 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:30.898870 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-5ebaab83-b58f-43a4-a0f3-29e27eb6674c tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:30.906333 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-5ebaab83-b58f-43a4-a0f3-29e27eb6674c tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.178716 Feb 04 18:01:30.906950 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 63/127] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:30 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:30.956288 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-f621a2ae-e3e8-4efa-8357-5bdfc0e002da tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:30.956884 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-f621a2ae-e3e8-4efa-8357-5bdfc0e002da tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:30.962810 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f621a2ae-e3e8-4efa-8357-5bdfc0e002da tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:30.963259 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f621a2ae-e3e8-4efa-8357-5bdfc0e002da tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:30.964028 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f621a2ae-e3e8-4efa-8357-5bdfc0e002da tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:30.964456 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f621a2ae-e3e8-4efa-8357-5bdfc0e002da tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:31.155199 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-f621a2ae-e3e8-4efa-8357-5bdfc0e002da tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:31.165104 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-f621a2ae-e3e8-4efa-8357-5bdfc0e002da tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:31.166396 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-f621a2ae-e3e8-4efa-8357-5bdfc0e002da tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:31.167527 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-f621a2ae-e3e8-4efa-8357-5bdfc0e002da tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1407 microversion: 2.20 time: 0.215054 Feb 04 18:01:31.168096 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 65/128] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:30 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:01:31.715826 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-26104fd7-344e-4d02-96ff-ef314d4fb045 req-09677f50-1b28-4d85-bf2c-6e48f62a422b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b81832-5021-4cd2-8ebf-767daeb17673", "name": "network-vif-plugged", "status": "completed", "tag": "448b92cf-8fd6-4137-a431-b26132b3bd03"}, {"server_uuid": "c1d9c781-2198-40c6-a4ec-cd2422de004d", "name": "network-vif-plugged", "status": "completed", "tag": "bd315958-9ef0-4c3f-ada4-ba8b1c05202e"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:01:31.718345 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:01:31.718345 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:01:31.731757 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-26104fd7-344e-4d02-96ff-ef314d4fb045 req-09677f50-1b28-4d85-bf2c-6e48f62a422b service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:31.732413 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-26104fd7-344e-4d02-96ff-ef314d4fb045 req-09677f50-1b28-4d85-bf2c-6e48f62a422b service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:31.743638 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c7722369-0232-4298-a428-1d71604b0a23 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:31.744982 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c7722369-0232-4298-a428-1d71604b0a23 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:31.751925 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c7722369-0232-4298-a428-1d71604b0a23 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:31.752625 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c7722369-0232-4298-a428-1d71604b0a23 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:31.822603 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c7722369-0232-4298-a428-1d71604b0a23 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:31.822603 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c7722369-0232-4298-a428-1d71604b0a23 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:31.823745 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-26104fd7-344e-4d02-96ff-ef314d4fb045 req-09677f50-1b28-4d85-bf2c-6e48f62a422b service nova] Creating event network-vif-plugged:448b92cf-8fd6-4137-a431-b26132b3bd03 for instance 16b81832-5021-4cd2-8ebf-767daeb17673 on hv-cinder-82276 Feb 04 18:01:31.823745 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-26104fd7-344e-4d02-96ff-ef314d4fb045 req-09677f50-1b28-4d85-bf2c-6e48f62a422b service nova] Creating event network-vif-plugged:bd315958-9ef0-4c3f-ada4-ba8b1c05202e for instance c1d9c781-2198-40c6-a4ec-cd2422de004d on hv-cinder-82276 Feb 04 18:01:31.823745 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-26104fd7-344e-4d02-96ff-ef314d4fb045 req-09677f50-1b28-4d85-bf2c-6e48f62a422b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059851 Feb 04 18:01:31.823745 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 64/129] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:01:31.823745 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-99951aa5-39e3-45c8-8d51-95de57c238f2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:31.824119 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-99951aa5-39e3-45c8-8d51-95de57c238f2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:31.824119 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-99951aa5-39e3-45c8-8d51-95de57c238f2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:31.824119 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-99951aa5-39e3-45c8-8d51-95de57c238f2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:31.824119 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-99951aa5-39e3-45c8-8d51-95de57c238f2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:31.824393 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-99951aa5-39e3-45c8-8d51-95de57c238f2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:31.965410 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c7722369-0232-4298-a428-1d71604b0a23 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:31.973859 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c7722369-0232-4298-a428-1d71604b0a23 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1322 microversion: 2.1 time: 0.234702 Feb 04 18:01:31.974485 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 66/130] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:31 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:31.984351 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-423718ea-1e81-495b-8d90-e1589e472e0b tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:31.985292 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-423718ea-1e81-495b-8d90-e1589e472e0b tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:32.000751 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-423718ea-1e81-495b-8d90-e1589e472e0b tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:32.001822 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-423718ea-1e81-495b-8d90-e1589e472e0b tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:32.002586 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-423718ea-1e81-495b-8d90-e1589e472e0b tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:32.003020 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-423718ea-1e81-495b-8d90-e1589e472e0b tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:32.010226 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-99951aa5-39e3-45c8-8d51-95de57c238f2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:32.022087 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-99951aa5-39e3-45c8-8d51-95de57c238f2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.248176 Feb 04 18:01:32.023233 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 65/131] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:31 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:32.173896 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-423718ea-1e81-495b-8d90-e1589e472e0b tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:32.185402 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-423718ea-1e81-495b-8d90-e1589e472e0b tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.204487 Feb 04 18:01:32.185402 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 67/132] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:31 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:32.185587 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-0581447b-f079-4373-af44-357a04a8cb2d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:32.185587 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-0581447b-f079-4373-af44-357a04a8cb2d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:32.192233 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0581447b-f079-4373-af44-357a04a8cb2d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:32.192683 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0581447b-f079-4373-af44-357a04a8cb2d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:32.193466 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0581447b-f079-4373-af44-357a04a8cb2d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:32.193899 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0581447b-f079-4373-af44-357a04a8cb2d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:32.334881 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-0581447b-f079-4373-af44-357a04a8cb2d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:32.343330 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-0581447b-f079-4373-af44-357a04a8cb2d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:32.344423 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-0581447b-f079-4373-af44-357a04a8cb2d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:32.346137 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-0581447b-f079-4373-af44-357a04a8cb2d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1407 microversion: 2.20 time: 0.164975 Feb 04 18:01:32.346841 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 66/133] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:32 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:01:32.996194 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-73056e2e-f63e-412c-8b2a-9d58bc0cc2c3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:32.996194 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-73056e2e-f63e-412c-8b2a-9d58bc0cc2c3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:33.002154 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-73056e2e-f63e-412c-8b2a-9d58bc0cc2c3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:33.002815 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-73056e2e-f63e-412c-8b2a-9d58bc0cc2c3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:33.003797 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-73056e2e-f63e-412c-8b2a-9d58bc0cc2c3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:33.004815 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-73056e2e-f63e-412c-8b2a-9d58bc0cc2c3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:33.039752 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-68a1f103-defb-4cc7-a1bc-24db94bba7e8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:33.046362 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-68a1f103-defb-4cc7-a1bc-24db94bba7e8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:33.049762 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-68a1f103-defb-4cc7-a1bc-24db94bba7e8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:33.050237 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-68a1f103-defb-4cc7-a1bc-24db94bba7e8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:33.051054 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-68a1f103-defb-4cc7-a1bc-24db94bba7e8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:33.051521 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-68a1f103-defb-4cc7-a1bc-24db94bba7e8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:33.330908 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-73056e2e-f63e-412c-8b2a-9d58bc0cc2c3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:33.338442 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-73056e2e-f63e-412c-8b2a-9d58bc0cc2c3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1322 microversion: 2.1 time: 0.349572 Feb 04 18:01:33.341852 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 68/134] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:32 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1322 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:33.344230 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-68a1f103-defb-4cc7-a1bc-24db94bba7e8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:33.345529 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-0b9dec22-4861-433b-bfec-39556aa60be2 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:33.346144 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-0b9dec22-4861-433b-bfec-39556aa60be2 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:33.353275 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0b9dec22-4861-433b-bfec-39556aa60be2 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:33.353724 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0b9dec22-4861-433b-bfec-39556aa60be2 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:33.355147 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0b9dec22-4861-433b-bfec-39556aa60be2 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:33.355748 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-68a1f103-defb-4cc7-a1bc-24db94bba7e8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.319568 Feb 04 18:01:33.355880 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0b9dec22-4861-433b-bfec-39556aa60be2 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:33.367776 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 67/135] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:33 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:33.375503 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-83aa1762-3c99-4a34-aacb-269297a4b329 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:33.376480 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-83aa1762-3c99-4a34-aacb-269297a4b329 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:33.382850 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-83aa1762-3c99-4a34-aacb-269297a4b329 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:33.383359 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-83aa1762-3c99-4a34-aacb-269297a4b329 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:33.384278 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-83aa1762-3c99-4a34-aacb-269297a4b329 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:33.384783 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-83aa1762-3c99-4a34-aacb-269297a4b329 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:33.570752 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-0b9dec22-4861-433b-bfec-39556aa60be2 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:33.577568 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-83aa1762-3c99-4a34-aacb-269297a4b329 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:33.578501 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-0b9dec22-4861-433b-bfec-39556aa60be2 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.237997 Feb 04 18:01:33.579828 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 69/136] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:33 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:33.586660 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-83aa1762-3c99-4a34-aacb-269297a4b329 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:33.590306 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-83aa1762-3c99-4a34-aacb-269297a4b329 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:33.590306 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-83aa1762-3c99-4a34-aacb-269297a4b329 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1407 microversion: 2.20 time: 0.217725 Feb 04 18:01:33.590306 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 68/137] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:33 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:01:34.355419 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-4dc1657c-600e-41e8-97ad-bed1a595971a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:34.356753 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-4dc1657c-600e-41e8-97ad-bed1a595971a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:34.362659 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4dc1657c-600e-41e8-97ad-bed1a595971a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:34.363108 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4dc1657c-600e-41e8-97ad-bed1a595971a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:34.364089 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4dc1657c-600e-41e8-97ad-bed1a595971a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:34.364532 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4dc1657c-600e-41e8-97ad-bed1a595971a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:34.372910 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-2c57160c-b481-4f91-993b-a3ea0ea4f4d7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:34.374084 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-2c57160c-b481-4f91-993b-a3ea0ea4f4d7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:34.380599 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2c57160c-b481-4f91-993b-a3ea0ea4f4d7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:34.381053 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2c57160c-b481-4f91-993b-a3ea0ea4f4d7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:34.381874 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2c57160c-b481-4f91-993b-a3ea0ea4f4d7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:34.382316 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2c57160c-b481-4f91-993b-a3ea0ea4f4d7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:34.584555 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-4dc1657c-600e-41e8-97ad-bed1a595971a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:34.588662 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2c57160c-b481-4f91-993b-a3ea0ea4f4d7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:34.592193 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-4dc1657c-600e-41e8-97ad-bed1a595971a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1322 microversion: 2.1 time: 0.240320 Feb 04 18:01:34.592889 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 70/138] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:34 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:34.596932 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-2c57160c-b481-4f91-993b-a3ea0ea4f4d7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.227505 Feb 04 18:01:34.598001 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b9d1579b-54ab-47fb-b030-c8b2dd98132d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:34.598642 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-b9d1579b-54ab-47fb-b030-c8b2dd98132d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:34.604596 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b9d1579b-54ab-47fb-b030-c8b2dd98132d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:34.605041 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b9d1579b-54ab-47fb-b030-c8b2dd98132d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:34.605822 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b9d1579b-54ab-47fb-b030-c8b2dd98132d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:34.606151 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 69/139] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:34 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:34.606257 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b9d1579b-54ab-47fb-b030-c8b2dd98132d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:34.610721 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-eaed834e-e2f8-41bb-8bac-a18f0aba7552 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:34.611399 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-eaed834e-e2f8-41bb-8bac-a18f0aba7552 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:34.617612 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-eaed834e-e2f8-41bb-8bac-a18f0aba7552 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:34.624795 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-eaed834e-e2f8-41bb-8bac-a18f0aba7552 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:34.624795 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-eaed834e-e2f8-41bb-8bac-a18f0aba7552 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:34.624795 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-eaed834e-e2f8-41bb-8bac-a18f0aba7552 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:34.811459 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-b9d1579b-54ab-47fb-b030-c8b2dd98132d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:34.819184 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b9d1579b-54ab-47fb-b030-c8b2dd98132d tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.225314 Feb 04 18:01:34.819747 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 71/140] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:34 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:34.830727 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-eaed834e-e2f8-41bb-8bac-a18f0aba7552 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:34.838825 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-eaed834e-e2f8-41bb-8bac-a18f0aba7552 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:34.840358 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-eaed834e-e2f8-41bb-8bac-a18f0aba7552 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:34.841446 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-eaed834e-e2f8-41bb-8bac-a18f0aba7552 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1407 microversion: 2.20 time: 0.234290 Feb 04 18:01:34.842009 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 70/141] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:34 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:01:35.609848 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-980b29ab-93b6-46cd-80f0-1ac3bbdef913 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:35.610438 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-980b29ab-93b6-46cd-80f0-1ac3bbdef913 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:35.612625 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-9d01271e-33d1-4042-b64c-af22a276812c tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:35.613238 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-9d01271e-33d1-4042-b64c-af22a276812c tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:35.616918 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-980b29ab-93b6-46cd-80f0-1ac3bbdef913 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:35.617050 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-980b29ab-93b6-46cd-80f0-1ac3bbdef913 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:35.617799 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-980b29ab-93b6-46cd-80f0-1ac3bbdef913 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:35.618356 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-980b29ab-93b6-46cd-80f0-1ac3bbdef913 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:35.619424 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9d01271e-33d1-4042-b64c-af22a276812c tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:35.619871 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9d01271e-33d1-4042-b64c-af22a276812c tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:35.620653 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9d01271e-33d1-4042-b64c-af22a276812c tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:35.621091 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9d01271e-33d1-4042-b64c-af22a276812c tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:35.814817 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-9d01271e-33d1-4042-b64c-af22a276812c tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:35.823297 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-980b29ab-93b6-46cd-80f0-1ac3bbdef913 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:35.825956 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-9d01271e-33d1-4042-b64c-af22a276812c tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.213819 Feb 04 18:01:35.829877 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 71/142] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:35 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:35.834564 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-980b29ab-93b6-46cd-80f0-1ac3bbdef913 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1322 microversion: 2.1 time: 0.228306 Feb 04 18:01:35.835788 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 72/143] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:35 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:35.836947 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-59e9c80d-5a98-47a9-99dd-efd4259d6ce1 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:35.837560 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-59e9c80d-5a98-47a9-99dd-efd4259d6ce1 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:35.843345 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-59e9c80d-5a98-47a9-99dd-efd4259d6ce1 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:35.843792 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-59e9c80d-5a98-47a9-99dd-efd4259d6ce1 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:35.844759 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-59e9c80d-5a98-47a9-99dd-efd4259d6ce1 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:35.845223 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-59e9c80d-5a98-47a9-99dd-efd4259d6ce1 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:35.859931 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-18edfe15-8197-41de-a1e9-398e81ad636f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:35.860569 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-18edfe15-8197-41de-a1e9-398e81ad636f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:35.869038 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-18edfe15-8197-41de-a1e9-398e81ad636f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:35.870025 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-18edfe15-8197-41de-a1e9-398e81ad636f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:35.871131 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-18edfe15-8197-41de-a1e9-398e81ad636f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:35.871573 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-18edfe15-8197-41de-a1e9-398e81ad636f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:36.045472 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-59e9c80d-5a98-47a9-99dd-efd4259d6ce1 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:36.053273 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-59e9c80d-5a98-47a9-99dd-efd4259d6ce1 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.220573 Feb 04 18:01:36.054040 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 72/144] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:35 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:36.060063 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-18edfe15-8197-41de-a1e9-398e81ad636f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:36.068469 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-18edfe15-8197-41de-a1e9-398e81ad636f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:36.069980 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-18edfe15-8197-41de-a1e9-398e81ad636f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:36.071146 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-18edfe15-8197-41de-a1e9-398e81ad636f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1407 microversion: 2.20 time: 0.215657 Feb 04 18:01:36.071703 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 73/145] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:35 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:01:36.844262 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-3794794d-cd13-42e3-95cd-444951bfde63 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:36.846468 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-3794794d-cd13-42e3-95cd-444951bfde63 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:36.853145 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-64f62c53-b78b-48aa-ab7e-f225439df172 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:36.853145 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-64f62c53-b78b-48aa-ab7e-f225439df172 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:36.855492 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3794794d-cd13-42e3-95cd-444951bfde63 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:36.856166 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3794794d-cd13-42e3-95cd-444951bfde63 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:36.857042 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3794794d-cd13-42e3-95cd-444951bfde63 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:36.857690 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3794794d-cd13-42e3-95cd-444951bfde63 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:36.858489 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-64f62c53-b78b-48aa-ab7e-f225439df172 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:36.858946 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-64f62c53-b78b-48aa-ab7e-f225439df172 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:36.860803 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-64f62c53-b78b-48aa-ab7e-f225439df172 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:36.861419 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-64f62c53-b78b-48aa-ab7e-f225439df172 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:37.081278 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-3794794d-cd13-42e3-95cd-444951bfde63 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:37.081411 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-64f62c53-b78b-48aa-ab7e-f225439df172 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:37.083663 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-3794794d-cd13-42e3-95cd-444951bfde63 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.242866 Feb 04 18:01:37.084518 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 73/146] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:36 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:37.088133 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-64f62c53-b78b-48aa-ab7e-f225439df172 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1322 microversion: 2.1 time: 0.240351 Feb 04 18:01:37.089870 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-75ea82bd-e977-4fc9-ae85-640ad0ea18cf tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:37.090753 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-75ea82bd-e977-4fc9-ae85-640ad0ea18cf tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:37.098728 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 74/147] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:36 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:37.104140 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-75ea82bd-e977-4fc9-ae85-640ad0ea18cf tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:37.104140 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-75ea82bd-e977-4fc9-ae85-640ad0ea18cf tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:37.104357 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-40ca8765-d8e0-4f06-a2bb-e9699ced7037 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:37.104805 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-40ca8765-d8e0-4f06-a2bb-e9699ced7037 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:37.106969 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-75ea82bd-e977-4fc9-ae85-640ad0ea18cf tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:37.107502 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-75ea82bd-e977-4fc9-ae85-640ad0ea18cf tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:37.111499 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-40ca8765-d8e0-4f06-a2bb-e9699ced7037 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:37.112117 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-40ca8765-d8e0-4f06-a2bb-e9699ced7037 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:37.112904 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-40ca8765-d8e0-4f06-a2bb-e9699ced7037 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:37.113340 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-40ca8765-d8e0-4f06-a2bb-e9699ced7037 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:37.322470 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-40ca8765-d8e0-4f06-a2bb-e9699ced7037 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:37.325194 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-75ea82bd-e977-4fc9-ae85-640ad0ea18cf tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:37.336584 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-75ea82bd-e977-4fc9-ae85-640ad0ea18cf tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.250212 Feb 04 18:01:37.346280 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 74/148] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:37 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:37.346659 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-40ca8765-d8e0-4f06-a2bb-e9699ced7037 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:37.346659 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-40ca8765-d8e0-4f06-a2bb-e9699ced7037 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:37.346659 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-40ca8765-d8e0-4f06-a2bb-e9699ced7037 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1407 microversion: 2.20 time: 0.244820 Feb 04 18:01:37.352049 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-5da9d43e-0ec5-483d-b0ad-5eca33a89af8 req-84f0ff21-cd05-4db5-91b2-534d6f0c3cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514ca883-72d2-4695-a4b6-47c18ce4add5", "name": "network-vif-plugged", "status": "completed", "tag": "fe3cfe16-c9c7-4dcd-a6bf-b32b9ba77df0"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:01:37.353833 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:01:37.353833 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:01:37.357575 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 75/149] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:37 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:01:37.362482 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-5da9d43e-0ec5-483d-b0ad-5eca33a89af8 req-84f0ff21-cd05-4db5-91b2-534d6f0c3cd0 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:37.362959 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-5da9d43e-0ec5-483d-b0ad-5eca33a89af8 req-84f0ff21-cd05-4db5-91b2-534d6f0c3cd0 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:37.374888 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-5da9d43e-0ec5-483d-b0ad-5eca33a89af8 req-84f0ff21-cd05-4db5-91b2-534d6f0c3cd0 service nova] Creating event network-vif-plugged:fe3cfe16-c9c7-4dcd-a6bf-b32b9ba77df0 for instance 514ca883-72d2-4695-a4b6-47c18ce4add5 on hv-cinder-82276 Feb 04 18:01:37.381082 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-5da9d43e-0ec5-483d-b0ad-5eca33a89af8 req-84f0ff21-cd05-4db5-91b2-534d6f0c3cd0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042407 Feb 04 18:01:37.381978 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 75/150] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:01:38.102604 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-665de682-5aac-4754-a167-54eef37c74d4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:38.103970 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-665de682-5aac-4754-a167-54eef37c74d4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:38.105296 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-2fec49ff-21a6-4834-a446-a2ac61e234b7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:38.111046 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-2fec49ff-21a6-4834-a446-a2ac61e234b7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:38.112850 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2fec49ff-21a6-4834-a446-a2ac61e234b7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:38.112996 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-665de682-5aac-4754-a167-54eef37c74d4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:38.113308 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2fec49ff-21a6-4834-a446-a2ac61e234b7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:38.113412 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-665de682-5aac-4754-a167-54eef37c74d4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:38.114113 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2fec49ff-21a6-4834-a446-a2ac61e234b7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:38.114244 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-665de682-5aac-4754-a167-54eef37c74d4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:38.114594 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2fec49ff-21a6-4834-a446-a2ac61e234b7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:38.114733 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-665de682-5aac-4754-a167-54eef37c74d4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:38.313548 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2fec49ff-21a6-4834-a446-a2ac61e234b7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:38.317172 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-665de682-5aac-4754-a167-54eef37c74d4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:38.321799 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-2fec49ff-21a6-4834-a446-a2ac61e234b7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1322 microversion: 2.1 time: 0.220373 Feb 04 18:01:38.322518 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 76/151] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:38 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:38.325167 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-665de682-5aac-4754-a167-54eef37c74d4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.227879 Feb 04 18:01:38.325911 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 76/152] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:38 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:38.353009 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-902dfd0c-1288-4a62-8854-8c75866602fc tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:38.353686 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-902dfd0c-1288-4a62-8854-8c75866602fc tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:38.359602 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-902dfd0c-1288-4a62-8854-8c75866602fc tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:38.360045 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-902dfd0c-1288-4a62-8854-8c75866602fc tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:38.360897 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-902dfd0c-1288-4a62-8854-8c75866602fc tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:38.361313 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-902dfd0c-1288-4a62-8854-8c75866602fc tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:38.364545 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-6e6ccde6-2bad-4e2c-9fcd-d429fd6c2f96 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:38.366591 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-6e6ccde6-2bad-4e2c-9fcd-d429fd6c2f96 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:38.373485 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6e6ccde6-2bad-4e2c-9fcd-d429fd6c2f96 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:38.376224 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6e6ccde6-2bad-4e2c-9fcd-d429fd6c2f96 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:38.376224 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6e6ccde6-2bad-4e2c-9fcd-d429fd6c2f96 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:38.376224 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6e6ccde6-2bad-4e2c-9fcd-d429fd6c2f96 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:38.566894 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-902dfd0c-1288-4a62-8854-8c75866602fc tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:38.574215 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-902dfd0c-1288-4a62-8854-8c75866602fc tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.224832 Feb 04 18:01:38.575232 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 77/153] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:38 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:38.577441 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-6e6ccde6-2bad-4e2c-9fcd-d429fd6c2f96 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:38.585959 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-6e6ccde6-2bad-4e2c-9fcd-d429fd6c2f96 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:38.587484 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-6e6ccde6-2bad-4e2c-9fcd-d429fd6c2f96 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:38.588581 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-6e6ccde6-2bad-4e2c-9fcd-d429fd6c2f96 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1407 microversion: 2.20 time: 0.227955 Feb 04 18:01:38.589143 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 77/154] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:38 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:01:39.339293 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-92227fe8-fa10-4a46-b420-b8561dd61a56 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:39.339960 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-92227fe8-fa10-4a46-b420-b8561dd61a56 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:39.344632 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-05084012-ab49-413c-b8f9-1ca83a9a8f06 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:39.345891 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-92227fe8-fa10-4a46-b420-b8561dd61a56 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:39.346048 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-05084012-ab49-413c-b8f9-1ca83a9a8f06 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:39.346336 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-92227fe8-fa10-4a46-b420-b8561dd61a56 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:39.347162 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-92227fe8-fa10-4a46-b420-b8561dd61a56 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:39.347591 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-92227fe8-fa10-4a46-b420-b8561dd61a56 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:39.351987 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-05084012-ab49-413c-b8f9-1ca83a9a8f06 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:39.352436 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-05084012-ab49-413c-b8f9-1ca83a9a8f06 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:39.353411 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-05084012-ab49-413c-b8f9-1ca83a9a8f06 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:39.353851 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-05084012-ab49-413c-b8f9-1ca83a9a8f06 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:39.662960 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-92227fe8-fa10-4a46-b420-b8561dd61a56 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:39.670472 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-92227fe8-fa10-4a46-b420-b8561dd61a56 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1322 microversion: 2.1 time: 0.334896 Feb 04 18:01:39.678943 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 78/155] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:39 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:39.679192 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-05084012-ab49-413c-b8f9-1ca83a9a8f06 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:39.683310 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-d35426c0-49c6-40cf-83ec-b7303f521591 req-999d00aa-c31c-42bd-a9e7-4ab4883cd2ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374b4453-744e-4cb1-a6f4-b8c4d48e3a5f", "name": "network-vif-plugged", "status": "completed", "tag": "5c15984f-de2a-4353-acb0-e4952295b2eb"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:01:39.684342 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-05084012-ab49-413c-b8f9-1ca83a9a8f06 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.343767 Feb 04 18:01:39.684924 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 78/156] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:39 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:39.685042 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:01:39.685042 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:01:39.690180 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-ee0942cc-5548-44e8-bbf7-5865782f873f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:39.690810 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-ee0942cc-5548-44e8-bbf7-5865782f873f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:39.697742 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ee0942cc-5548-44e8-bbf7-5865782f873f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:39.698182 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ee0942cc-5548-44e8-bbf7-5865782f873f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:39.698637 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-d35426c0-49c6-40cf-83ec-b7303f521591 req-999d00aa-c31c-42bd-a9e7-4ab4883cd2ca service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:39.704034 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-d35426c0-49c6-40cf-83ec-b7303f521591 req-999d00aa-c31c-42bd-a9e7-4ab4883cd2ca service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:39.704433 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ee0942cc-5548-44e8-bbf7-5865782f873f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:39.704883 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ee0942cc-5548-44e8-bbf7-5865782f873f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:39.716193 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-d35426c0-49c6-40cf-83ec-b7303f521591 req-999d00aa-c31c-42bd-a9e7-4ab4883cd2ca service nova] Creating event network-vif-plugged:5c15984f-de2a-4353-acb0-e4952295b2eb for instance 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f on hv-cinder-82276 Feb 04 18:01:39.721210 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-d35426c0-49c6-40cf-83ec-b7303f521591 req-999d00aa-c31c-42bd-a9e7-4ab4883cd2ca service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049033 Feb 04 18:01:39.721883 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 79/157] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:01:39.727104 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-0e474a99-1654-41e8-8a4f-64a5d18a7915 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:39.727805 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-0e474a99-1654-41e8-8a4f-64a5d18a7915 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:39.733735 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0e474a99-1654-41e8-8a4f-64a5d18a7915 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:39.734187 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0e474a99-1654-41e8-8a4f-64a5d18a7915 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:39.735982 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0e474a99-1654-41e8-8a4f-64a5d18a7915 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:39.736419 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0e474a99-1654-41e8-8a4f-64a5d18a7915 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:39.900822 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ee0942cc-5548-44e8-bbf7-5865782f873f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:39.908905 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-ee0942cc-5548-44e8-bbf7-5865782f873f tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.222686 Feb 04 18:01:39.909489 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 79/158] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:39 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:39.928604 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-0e474a99-1654-41e8-8a4f-64a5d18a7915 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:39.936499 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-0e474a99-1654-41e8-8a4f-64a5d18a7915 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:39.938031 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-0e474a99-1654-41e8-8a4f-64a5d18a7915 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:39.939779 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-0e474a99-1654-41e8-8a4f-64a5d18a7915 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1407 microversion: 2.20 time: 0.216570 Feb 04 18:01:39.940347 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 80/159] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:39 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:01:40.688122 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-f2c11b87-1234-4c8f-a1c1-4542ccdc21bc tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:40.689263 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-f2c11b87-1234-4c8f-a1c1-4542ccdc21bc tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:40.695167 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f2c11b87-1234-4c8f-a1c1-4542ccdc21bc tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:40.695617 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f2c11b87-1234-4c8f-a1c1-4542ccdc21bc tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:40.696398 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f2c11b87-1234-4c8f-a1c1-4542ccdc21bc tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:40.696843 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f2c11b87-1234-4c8f-a1c1-4542ccdc21bc tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:40.701915 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-730cf100-9c65-45e7-82af-b38693fe4c6e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:40.703091 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-730cf100-9c65-45e7-82af-b38693fe4c6e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:40.709014 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-730cf100-9c65-45e7-82af-b38693fe4c6e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:40.709459 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-730cf100-9c65-45e7-82af-b38693fe4c6e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:40.710239 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-730cf100-9c65-45e7-82af-b38693fe4c6e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:40.710712 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-730cf100-9c65-45e7-82af-b38693fe4c6e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:40.905761 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-f2c11b87-1234-4c8f-a1c1-4542ccdc21bc tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:40.910245 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-730cf100-9c65-45e7-82af-b38693fe4c6e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:40.913879 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-f2c11b87-1234-4c8f-a1c1-4542ccdc21bc tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1322 microversion: 2.1 time: 0.229509 Feb 04 18:01:40.914468 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 80/160] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:40 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:40.917430 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-730cf100-9c65-45e7-82af-b38693fe4c6e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.219156 Feb 04 18:01:40.917999 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 81/161] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:40 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:40.927511 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-8e196e8d-86ea-4dc7-87ca-79c8c2afe38a tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:40.928126 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-8e196e8d-86ea-4dc7-87ca-79c8c2afe38a tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:40.934339 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8e196e8d-86ea-4dc7-87ca-79c8c2afe38a tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:40.934822 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8e196e8d-86ea-4dc7-87ca-79c8c2afe38a tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:40.935601 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8e196e8d-86ea-4dc7-87ca-79c8c2afe38a tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:40.936039 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8e196e8d-86ea-4dc7-87ca-79c8c2afe38a tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:40.957219 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-0e6a55ae-821b-4f19-860b-8b0214e01c41 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:40.957890 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-0e6a55ae-821b-4f19-860b-8b0214e01c41 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:40.964135 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0e6a55ae-821b-4f19-860b-8b0214e01c41 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:40.964585 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0e6a55ae-821b-4f19-860b-8b0214e01c41 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:40.965775 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0e6a55ae-821b-4f19-860b-8b0214e01c41 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:40.966214 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0e6a55ae-821b-4f19-860b-8b0214e01c41 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:41.318205 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-8e196e8d-86ea-4dc7-87ca-79c8c2afe38a tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:41.321607 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-0e6a55ae-821b-4f19-860b-8b0214e01c41 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:41.325463 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-8e196e8d-86ea-4dc7-87ca-79c8c2afe38a tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.401525 Feb 04 18:01:41.326046 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 81/162] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:40 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:41.329457 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-0e6a55ae-821b-4f19-860b-8b0214e01c41 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:41.330997 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-0e6a55ae-821b-4f19-860b-8b0214e01c41 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:41.332095 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-0e6a55ae-821b-4f19-860b-8b0214e01c41 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1407 microversion: 2.20 time: 0.378554 Feb 04 18:01:41.332650 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 82/163] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:40 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1407 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:01:41.939285 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c5d7ab07-acfa-4efe-a3b8-117988d782a6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:41.939796 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-103d7d26-2e25-43cd-85ca-2043d4241a1c tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:41.940162 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c5d7ab07-acfa-4efe-a3b8-117988d782a6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:41.940239 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-103d7d26-2e25-43cd-85ca-2043d4241a1c tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:41.946076 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c5d7ab07-acfa-4efe-a3b8-117988d782a6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:41.946403 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-103d7d26-2e25-43cd-85ca-2043d4241a1c tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:41.946588 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c5d7ab07-acfa-4efe-a3b8-117988d782a6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:41.947329 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c5d7ab07-acfa-4efe-a3b8-117988d782a6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:41.947445 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-103d7d26-2e25-43cd-85ca-2043d4241a1c tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:41.947759 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c5d7ab07-acfa-4efe-a3b8-117988d782a6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:41.948306 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-103d7d26-2e25-43cd-85ca-2043d4241a1c tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:41.948832 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-103d7d26-2e25-43cd-85ca-2043d4241a1c tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:42.147733 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c5d7ab07-acfa-4efe-a3b8-117988d782a6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:42.154803 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-103d7d26-2e25-43cd-85ca-2043d4241a1c tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:42.155973 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c5d7ab07-acfa-4efe-a3b8-117988d782a6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1322 microversion: 2.1 time: 0.228371 Feb 04 18:01:42.155973 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 82/164] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:41 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:42.167311 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-103d7d26-2e25-43cd-85ca-2043d4241a1c tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.233274 Feb 04 18:01:42.168311 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 83/165] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:41 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:42.342349 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-91c5b3ff-2e0e-48c0-92f5-2000b3c67351 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:42.343004 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-91c5b3ff-2e0e-48c0-92f5-2000b3c67351 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:42.348737 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-72208a6c-ea65-41a7-834f-f40a823df490 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:42.349352 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-72208a6c-ea65-41a7-834f-f40a823df490 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:42.350029 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-91c5b3ff-2e0e-48c0-92f5-2000b3c67351 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:42.350508 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-91c5b3ff-2e0e-48c0-92f5-2000b3c67351 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:42.351295 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-91c5b3ff-2e0e-48c0-92f5-2000b3c67351 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:42.351733 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-91c5b3ff-2e0e-48c0-92f5-2000b3c67351 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:42.355198 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-72208a6c-ea65-41a7-834f-f40a823df490 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:42.355651 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-72208a6c-ea65-41a7-834f-f40a823df490 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:42.356469 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-72208a6c-ea65-41a7-834f-f40a823df490 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:42.356911 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-72208a6c-ea65-41a7-834f-f40a823df490 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:42.548753 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-91c5b3ff-2e0e-48c0-92f5-2000b3c67351 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:42.555948 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-72208a6c-ea65-41a7-834f-f40a823df490 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:42.556434 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-91c5b3ff-2e0e-48c0-92f5-2000b3c67351 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.218001 Feb 04 18:01:42.557025 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 83/166] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:42 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:42.564317 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-72208a6c-ea65-41a7-834f-f40a823df490 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:42.565934 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-72208a6c-ea65-41a7-834f-f40a823df490 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:42.567105 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-72208a6c-ea65-41a7-834f-f40a823df490 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1407 microversion: 2.20 time: 0.222091 Feb 04 18:01:42.567668 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 84/167] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:42 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:01:43.171900 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-833a8174-9e8b-4a14-ac34-f1cc7282a9fa tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:43.172539 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-833a8174-9e8b-4a14-ac34-f1cc7282a9fa tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:43.178435 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-833a8174-9e8b-4a14-ac34-f1cc7282a9fa tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:43.178902 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-833a8174-9e8b-4a14-ac34-f1cc7282a9fa tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:43.185416 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-833a8174-9e8b-4a14-ac34-f1cc7282a9fa tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:43.185416 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-833a8174-9e8b-4a14-ac34-f1cc7282a9fa tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:43.185755 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-e4b86314-a068-4169-a958-ca7a8201a400 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:43.185755 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-e4b86314-a068-4169-a958-ca7a8201a400 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:43.192077 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e4b86314-a068-4169-a958-ca7a8201a400 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:43.192483 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e4b86314-a068-4169-a958-ca7a8201a400 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:43.193268 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e4b86314-a068-4169-a958-ca7a8201a400 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:43.193922 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e4b86314-a068-4169-a958-ca7a8201a400 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:43.392461 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-833a8174-9e8b-4a14-ac34-f1cc7282a9fa tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:43.396135 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-e4b86314-a068-4169-a958-ca7a8201a400 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:43.400394 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-833a8174-9e8b-4a14-ac34-f1cc7282a9fa tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1322 microversion: 2.1 time: 0.232088 Feb 04 18:01:43.400978 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 84/168] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:43 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:43.403667 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-e4b86314-a068-4169-a958-ca7a8201a400 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1317 microversion: 2.1 time: 0.222480 Feb 04 18:01:43.404546 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 85/169] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:43 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:43.573026 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-f0e9d900-8942-4bb8-b6c1-22dbfd1d5d18 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:43.573630 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-f0e9d900-8942-4bb8-b6c1-22dbfd1d5d18 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:43.579951 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f0e9d900-8942-4bb8-b6c1-22dbfd1d5d18 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:43.580407 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f0e9d900-8942-4bb8-b6c1-22dbfd1d5d18 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:43.581179 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f0e9d900-8942-4bb8-b6c1-22dbfd1d5d18 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:43.581616 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f0e9d900-8942-4bb8-b6c1-22dbfd1d5d18 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:43.585219 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-6a997c48-757f-411a-b678-ccdcf746a0f3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:43.589990 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-6a997c48-757f-411a-b678-ccdcf746a0f3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:43.591606 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6a997c48-757f-411a-b678-ccdcf746a0f3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:43.592047 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6a997c48-757f-411a-b678-ccdcf746a0f3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:43.592857 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6a997c48-757f-411a-b678-ccdcf746a0f3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:43.593284 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6a997c48-757f-411a-b678-ccdcf746a0f3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:43.790381 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-f0e9d900-8942-4bb8-b6c1-22dbfd1d5d18 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:43.794981 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-6a997c48-757f-411a-b678-ccdcf746a0f3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:43.797776 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-f0e9d900-8942-4bb8-b6c1-22dbfd1d5d18 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1315 microversion: 2.1 time: 0.228324 Feb 04 18:01:43.798341 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 85/170] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:43 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:43.801227 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-6a997c48-757f-411a-b678-ccdcf746a0f3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:43.802761 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-6a997c48-757f-411a-b678-ccdcf746a0f3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:43.803855 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-6a997c48-757f-411a-b678-ccdcf746a0f3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1407 microversion: 2.20 time: 0.222239 Feb 04 18:01:43.804421 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 86/171] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:43 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:01:44.416941 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-ab93c239-1201-46b4-9bb1-c17140d25cfc tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:44.417664 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-ab93c239-1201-46b4-9bb1-c17140d25cfc tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:44.421583 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-6f896afc-23d1-4cdb-bc0d-1663292f4a97 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:44.422200 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-6f896afc-23d1-4cdb-bc0d-1663292f4a97 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:44.424934 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ab93c239-1201-46b4-9bb1-c17140d25cfc tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:44.425816 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ab93c239-1201-46b4-9bb1-c17140d25cfc tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:44.427048 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ab93c239-1201-46b4-9bb1-c17140d25cfc tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:44.427680 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ab93c239-1201-46b4-9bb1-c17140d25cfc tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:44.428640 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6f896afc-23d1-4cdb-bc0d-1663292f4a97 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:44.429108 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6f896afc-23d1-4cdb-bc0d-1663292f4a97 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:44.429952 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6f896afc-23d1-4cdb-bc0d-1663292f4a97 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:44.430392 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6f896afc-23d1-4cdb-bc0d-1663292f4a97 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:44.629628 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-6f896afc-23d1-4cdb-bc0d-1663292f4a97 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:44.637162 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-6f896afc-23d1-4cdb-bc0d-1663292f4a97 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1508 microversion: 2.1 time: 0.220084 Feb 04 18:01:44.637749 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 87/172] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:44 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1508 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:44.657356 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ab93c239-1201-46b4-9bb1-c17140d25cfc tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:44.665127 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-ab93c239-1201-46b4-9bb1-c17140d25cfc tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1322 microversion: 2.1 time: 0.251911 Feb 04 18:01:44.666199 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 86/173] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:44 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:44.814492 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-515c23a7-5adc-4f2f-81ba-031ad40fae2a tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:44.815108 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-515c23a7-5adc-4f2f-81ba-031ad40fae2a tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:44.821679 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-515c23a7-5adc-4f2f-81ba-031ad40fae2a tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:44.821881 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-85a280f1-6f5f-43dd-92b6-b538c8a1bbd2 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:44.822129 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-515c23a7-5adc-4f2f-81ba-031ad40fae2a tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:44.822554 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-85a280f1-6f5f-43dd-92b6-b538c8a1bbd2 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:44.822994 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-515c23a7-5adc-4f2f-81ba-031ad40fae2a tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:44.823380 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-515c23a7-5adc-4f2f-81ba-031ad40fae2a tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:44.828814 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-85a280f1-6f5f-43dd-92b6-b538c8a1bbd2 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:44.829257 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-85a280f1-6f5f-43dd-92b6-b538c8a1bbd2 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:44.830039 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-85a280f1-6f5f-43dd-92b6-b538c8a1bbd2 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:44.830494 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-85a280f1-6f5f-43dd-92b6-b538c8a1bbd2 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:45.026992 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-515c23a7-5adc-4f2f-81ba-031ad40fae2a tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:45.035458 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-515c23a7-5adc-4f2f-81ba-031ad40fae2a tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1501 microversion: 2.1 time: 0.224704 Feb 04 18:01:45.036041 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 88/174] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:44 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1501 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:45.042295 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-85a280f1-6f5f-43dd-92b6-b538c8a1bbd2 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:45.050460 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-85a280f1-6f5f-43dd-92b6-b538c8a1bbd2 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:45.051952 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-85a280f1-6f5f-43dd-92b6-b538c8a1bbd2 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:45.053040 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-85a280f1-6f5f-43dd-92b6-b538c8a1bbd2 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1407 microversion: 2.20 time: 0.234777 Feb 04 18:01:45.053605 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 87/175] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:44 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:01:45.682615 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-4073b4ac-40c3-4169-80f1-3503ffa5d2b9 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:45.683226 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-4073b4ac-40c3-4169-80f1-3503ffa5d2b9 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:45.689721 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4073b4ac-40c3-4169-80f1-3503ffa5d2b9 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:45.690174 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4073b4ac-40c3-4169-80f1-3503ffa5d2b9 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:45.690982 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4073b4ac-40c3-4169-80f1-3503ffa5d2b9 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:45.691423 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4073b4ac-40c3-4169-80f1-3503ffa5d2b9 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:45.837684 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-4073b4ac-40c3-4169-80f1-3503ffa5d2b9 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:45.846543 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-4073b4ac-40c3-4169-80f1-3503ffa5d2b9 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1322 microversion: 2.1 time: 0.167425 Feb 04 18:01:45.847574 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 89/176] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:45 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:46.072368 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-ba0ab521-5435-424f-8e98-515de667ce38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:46.072916 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-ba0ab521-5435-424f-8e98-515de667ce38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:46.089034 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ba0ab521-5435-424f-8e98-515de667ce38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:46.089500 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ba0ab521-5435-424f-8e98-515de667ce38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:46.101385 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ba0ab521-5435-424f-8e98-515de667ce38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:46.101385 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ba0ab521-5435-424f-8e98-515de667ce38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:46.231113 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ba0ab521-5435-424f-8e98-515de667ce38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:46.239675 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ba0ab521-5435-424f-8e98-515de667ce38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:46.241472 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ba0ab521-5435-424f-8e98-515de667ce38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:46.242707 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-ba0ab521-5435-424f-8e98-515de667ce38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1407 microversion: 2.20 time: 0.174077 Feb 04 18:01:46.243253 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 88/177] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:46 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:01:46.863634 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-10c41630-26b0-4d8b-8787-b14430c248be tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:46.864278 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-10c41630-26b0-4d8b-8787-b14430c248be tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:46.872518 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-10c41630-26b0-4d8b-8787-b14430c248be tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:46.872960 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-10c41630-26b0-4d8b-8787-b14430c248be tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:46.873746 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-10c41630-26b0-4d8b-8787-b14430c248be tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:46.874181 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-10c41630-26b0-4d8b-8787-b14430c248be tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:47.024461 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-10c41630-26b0-4d8b-8787-b14430c248be tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:47.032604 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-10c41630-26b0-4d8b-8787-b14430c248be tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1517 microversion: 2.1 time: 0.173003 Feb 04 18:01:47.033751 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 90/178] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:46 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:47.051370 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-0e48bc6c-c12e-4660-9942-c80cb35acff2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:01:47.052381 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-0e48bc6c-c12e-4660-9942-c80cb35acff2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:47.058169 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0e48bc6c-c12e-4660-9942-c80cb35acff2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:47.058658 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0e48bc6c-c12e-4660-9942-c80cb35acff2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:47.059434 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0e48bc6c-c12e-4660-9942-c80cb35acff2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:47.059876 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0e48bc6c-c12e-4660-9942-c80cb35acff2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:47.121239 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.objects.instance [None req-0e48bc6c-c12e-4660-9942-c80cb35acff2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lazy-loading 'flavor' on Instance uuid 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f {{(pid=123567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:01:47.262595 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-a439f4ca-3f6a-4e42-a4af-a7e4eaf30a60 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:47.263300 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-a439f4ca-3f6a-4e42-a4af-a7e4eaf30a60 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:47.269907 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a439f4ca-3f6a-4e42-a4af-a7e4eaf30a60 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:47.270358 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a439f4ca-3f6a-4e42-a4af-a7e4eaf30a60 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:47.271226 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a439f4ca-3f6a-4e42-a4af-a7e4eaf30a60 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:47.271664 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a439f4ca-3f6a-4e42-a4af-a7e4eaf30a60 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:47.433911 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-a439f4ca-3f6a-4e42-a4af-a7e4eaf30a60 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:47.442954 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-a439f4ca-3f6a-4e42-a4af-a7e4eaf30a60 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:47.444691 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-a439f4ca-3f6a-4e42-a4af-a7e4eaf30a60 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:47.445815 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-a439f4ca-3f6a-4e42-a4af-a7e4eaf30a60 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1597 microversion: 2.20 time: 0.189129 Feb 04 18:01:47.446388 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 91/179] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:47 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1597 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:01:47.463935 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-a82f8a0f-e803-4002-ad9b-c7a243f16922 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:47.464430 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-a82f8a0f-e803-4002-ad9b-c7a243f16922 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:47.470182 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a82f8a0f-e803-4002-ad9b-c7a243f16922 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:47.470690 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a82f8a0f-e803-4002-ad9b-c7a243f16922 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:47.471472 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a82f8a0f-e803-4002-ad9b-c7a243f16922 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:47.471895 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a82f8a0f-e803-4002-ad9b-c7a243f16922 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:47.526131 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-0e48bc6c-c12e-4660-9942-c80cb35acff2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "POST /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f/action" status: 200 len: 32 microversion: 2.1 time: 0.479023 Feb 04 18:01:47.526884 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 89/180] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Feb 4 18:01:47 2022] POST /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f/action => generated 32 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 04 18:01:47.541816 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c8e6880d-6bd5-4b42-8ccc-3caa26bd3145 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:47.543186 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c8e6880d-6bd5-4b42-8ccc-3caa26bd3145 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:47.556752 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c8e6880d-6bd5-4b42-8ccc-3caa26bd3145 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:47.557408 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c8e6880d-6bd5-4b42-8ccc-3caa26bd3145 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:47.558342 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c8e6880d-6bd5-4b42-8ccc-3caa26bd3145 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:47.559016 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c8e6880d-6bd5-4b42-8ccc-3caa26bd3145 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:47.706949 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-a82f8a0f-e803-4002-ad9b-c7a243f16922 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.246697 Feb 04 18:01:47.707760 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 92/181] 10.222.0.98 () {60 vars in 1315 bytes} [Fri Feb 4 18:01:47 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5/os-interface => generated 284 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 04 18:01:47.722646 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-fe12a469-ef12-4eb1-af1d-811db76ff255 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8b4480b-dcfc-4a20-a04f-49b4075a99d2"}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:01:47.723995 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-fe12a469-ef12-4eb1-af1d-811db76ff255 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:47.737835 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fe12a469-ef12-4eb1-af1d-811db76ff255 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:47.741941 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fe12a469-ef12-4eb1-af1d-811db76ff255 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:47.742859 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fe12a469-ef12-4eb1-af1d-811db76ff255 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:47.743282 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fe12a469-ef12-4eb1-af1d-811db76ff255 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:48.273953 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c8e6880d-6bd5-4b42-8ccc-3caa26bd3145 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:48.281464 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c8e6880d-6bd5-4b42-8ccc-3caa26bd3145 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.743603 Feb 04 18:01:48.291210 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 90/182] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:47 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:48.782030 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-fe12a469-ef12-4eb1-af1d-811db76ff255 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "POST /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.066054 Feb 04 18:01:48.783083 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 93/183] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Feb 4 18:01:47 2022] POST /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d/os-volume_attachments => generated 194 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:01:48.815934 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3cae62d8-2483-4a0a-9a5b-1f79548691f1 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aac5aeff-5f04-4df1-8aef-27acc238ec4c"}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:01:48.817143 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-3cae62d8-2483-4a0a-9a5b-1f79548691f1 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:48.823078 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3cae62d8-2483-4a0a-9a5b-1f79548691f1 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:48.823539 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3cae62d8-2483-4a0a-9a5b-1f79548691f1 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:48.824304 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3cae62d8-2483-4a0a-9a5b-1f79548691f1 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:48.824734 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3cae62d8-2483-4a0a-9a5b-1f79548691f1 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:49.300585 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ed9a6a10-c642-4836-b5b2-b363a51c1d10 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:49.301365 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ed9a6a10-c642-4836-b5b2-b363a51c1d10 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:49.308281 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ed9a6a10-c642-4836-b5b2-b363a51c1d10 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:49.308841 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ed9a6a10-c642-4836-b5b2-b363a51c1d10 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:49.309697 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ed9a6a10-c642-4836-b5b2-b363a51c1d10 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:49.310200 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ed9a6a10-c642-4836-b5b2-b363a51c1d10 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:49.551952 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-ed9a6a10-c642-4836-b5b2-b363a51c1d10 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:49.568575 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ed9a6a10-c642-4836-b5b2-b363a51c1d10 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.273329 Feb 04 18:01:49.569358 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 94/184] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:49 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:49.609084 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-247dfc29-fb33-4080-88ce-759a75ba542b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:49.610011 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-247dfc29-fb33-4080-88ce-759a75ba542b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:49.618244 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-247dfc29-fb33-4080-88ce-759a75ba542b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:49.620210 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-247dfc29-fb33-4080-88ce-759a75ba542b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:49.621171 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-247dfc29-fb33-4080-88ce-759a75ba542b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:49.621600 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-247dfc29-fb33-4080-88ce-759a75ba542b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:49.775496 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-247dfc29-fb33-4080-88ce-759a75ba542b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:49.784745 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-247dfc29-fb33-4080-88ce-759a75ba542b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:49.786986 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-247dfc29-fb33-4080-88ce-759a75ba542b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:49.788516 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-247dfc29-fb33-4080-88ce-759a75ba542b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1597 microversion: 2.20 time: 0.185855 Feb 04 18:01:49.789881 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 95/185] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:49 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1597 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:01:49.794597 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-e1512607-310d-4186-8988-ab309c706efa req-4d90fd4b-0078-486b-8caf-65c825927744 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "514ca883-72d2-4695-a4b6-47c18ce4add5", "tag": "fe3cfe16-c9c7-4dcd-a6bf-b32b9ba77df0"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:01:49.796530 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:01:49.796530 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:01:49.804527 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-e1512607-310d-4186-8988-ab309c706efa req-4d90fd4b-0078-486b-8caf-65c825927744 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:49.805295 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-e1512607-310d-4186-8988-ab309c706efa req-4d90fd4b-0078-486b-8caf-65c825927744 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:49.817396 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-e1512607-310d-4186-8988-ab309c706efa req-4d90fd4b-0078-486b-8caf-65c825927744 service nova] Creating event network-changed:fe3cfe16-c9c7-4dcd-a6bf-b32b9ba77df0 for instance 514ca883-72d2-4695-a4b6-47c18ce4add5 on hv-cinder-82276 Feb 04 18:01:49.823050 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-e1512607-310d-4186-8988-ab309c706efa req-4d90fd4b-0078-486b-8caf-65c825927744 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031748 Feb 04 18:01:49.823959 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 96/186] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:01:50.585894 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-be0ba9d2-0cd3-47b7-b0d0-75ae8d606aab tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:50.586662 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-be0ba9d2-0cd3-47b7-b0d0-75ae8d606aab tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:50.592829 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-be0ba9d2-0cd3-47b7-b0d0-75ae8d606aab tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:50.593290 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-be0ba9d2-0cd3-47b7-b0d0-75ae8d606aab tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:50.594789 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-be0ba9d2-0cd3-47b7-b0d0-75ae8d606aab tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:50.595226 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-be0ba9d2-0cd3-47b7-b0d0-75ae8d606aab tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:50.740520 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-be0ba9d2-0cd3-47b7-b0d0-75ae8d606aab tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:50.749061 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-be0ba9d2-0cd3-47b7-b0d0-75ae8d606aab tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.167547 Feb 04 18:01:50.749752 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 97/187] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:50 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:50.817044 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-9fac26fb-210d-4515-9110-4fe3f0bfe7ef tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:50.817724 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-9fac26fb-210d-4515-9110-4fe3f0bfe7ef tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:50.823601 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9fac26fb-210d-4515-9110-4fe3f0bfe7ef tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:50.824114 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9fac26fb-210d-4515-9110-4fe3f0bfe7ef tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:50.824906 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9fac26fb-210d-4515-9110-4fe3f0bfe7ef tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:50.825345 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9fac26fb-210d-4515-9110-4fe3f0bfe7ef tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:50.963996 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-9fac26fb-210d-4515-9110-4fe3f0bfe7ef tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:50.972285 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-9fac26fb-210d-4515-9110-4fe3f0bfe7ef tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:50.973894 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-9fac26fb-210d-4515-9110-4fe3f0bfe7ef tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:50.974982 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-9fac26fb-210d-4515-9110-4fe3f0bfe7ef tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1597 microversion: 2.20 time: 0.161708 Feb 04 18:01:50.975551 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 98/188] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:50 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1597 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:01:51.767401 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-c69e07da-9640-452a-985a-b5a7d57f0e51 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:51.768172 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-c69e07da-9640-452a-985a-b5a7d57f0e51 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:51.774619 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c69e07da-9640-452a-985a-b5a7d57f0e51 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:51.775062 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c69e07da-9640-452a-985a-b5a7d57f0e51 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:51.775833 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c69e07da-9640-452a-985a-b5a7d57f0e51 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:51.776260 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c69e07da-9640-452a-985a-b5a7d57f0e51 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:51.912094 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c69e07da-9640-452a-985a-b5a7d57f0e51 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:51.919456 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-c69e07da-9640-452a-985a-b5a7d57f0e51 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.156298 Feb 04 18:01:51.920034 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 99/189] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:51 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:51.993118 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-c0231175-ed37-4f87-88a7-8dcccbea8c40 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:51.993728 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-c0231175-ed37-4f87-88a7-8dcccbea8c40 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:51.999627 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c0231175-ed37-4f87-88a7-8dcccbea8c40 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:52.000111 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c0231175-ed37-4f87-88a7-8dcccbea8c40 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:52.000894 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c0231175-ed37-4f87-88a7-8dcccbea8c40 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:52.001336 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c0231175-ed37-4f87-88a7-8dcccbea8c40 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:52.137496 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c0231175-ed37-4f87-88a7-8dcccbea8c40 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:52.146697 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c0231175-ed37-4f87-88a7-8dcccbea8c40 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:52.147814 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c0231175-ed37-4f87-88a7-8dcccbea8c40 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:52.148940 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-c0231175-ed37-4f87-88a7-8dcccbea8c40 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1597 microversion: 2.20 time: 0.159745 Feb 04 18:01:52.149519 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 100/190] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:51 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1597 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:01:52.936058 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-0314c079-ec2c-4ac6-a23f-0d9b85732960 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:52.936707 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-0314c079-ec2c-4ac6-a23f-0d9b85732960 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:52.942972 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0314c079-ec2c-4ac6-a23f-0d9b85732960 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:52.943426 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0314c079-ec2c-4ac6-a23f-0d9b85732960 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:52.944208 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0314c079-ec2c-4ac6-a23f-0d9b85732960 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:52.944677 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0314c079-ec2c-4ac6-a23f-0d9b85732960 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:53.077180 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-0314c079-ec2c-4ac6-a23f-0d9b85732960 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:53.084543 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-0314c079-ec2c-4ac6-a23f-0d9b85732960 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.152122 Feb 04 18:01:53.085109 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 101/191] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:52 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:53.165967 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-138208e5-c776-4574-a586-cc81197678c4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:53.166603 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-138208e5-c776-4574-a586-cc81197678c4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:53.172851 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-138208e5-c776-4574-a586-cc81197678c4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:53.173296 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-138208e5-c776-4574-a586-cc81197678c4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:53.174059 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-138208e5-c776-4574-a586-cc81197678c4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:53.174516 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-138208e5-c776-4574-a586-cc81197678c4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:53.302761 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-138208e5-c776-4574-a586-cc81197678c4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:53.310510 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-138208e5-c776-4574-a586-cc81197678c4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:53.312011 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-138208e5-c776-4574-a586-cc81197678c4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:53.313144 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-138208e5-c776-4574-a586-cc81197678c4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1597 microversion: 2.20 time: 0.150892 Feb 04 18:01:53.313718 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 102/192] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:53 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1597 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:01:54.100681 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-14468390-6366-4ff8-a1ff-2c0dac7df007 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:54.101279 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-14468390-6366-4ff8-a1ff-2c0dac7df007 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:54.108117 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-14468390-6366-4ff8-a1ff-2c0dac7df007 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:54.108590 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-14468390-6366-4ff8-a1ff-2c0dac7df007 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:54.109914 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-14468390-6366-4ff8-a1ff-2c0dac7df007 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:54.110352 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-14468390-6366-4ff8-a1ff-2c0dac7df007 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:54.266065 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-14468390-6366-4ff8-a1ff-2c0dac7df007 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:54.273454 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-14468390-6366-4ff8-a1ff-2c0dac7df007 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.176404 Feb 04 18:01:54.274087 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 103/193] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:54 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:54.330691 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-602fbbc4-d234-46ac-a131-5fbd9d4cc169 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:54.331457 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-602fbbc4-d234-46ac-a131-5fbd9d4cc169 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:54.337668 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-602fbbc4-d234-46ac-a131-5fbd9d4cc169 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:54.338118 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-602fbbc4-d234-46ac-a131-5fbd9d4cc169 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:54.339022 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-602fbbc4-d234-46ac-a131-5fbd9d4cc169 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:54.339484 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-602fbbc4-d234-46ac-a131-5fbd9d4cc169 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:54.476740 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-602fbbc4-d234-46ac-a131-5fbd9d4cc169 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:54.484525 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-602fbbc4-d234-46ac-a131-5fbd9d4cc169 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:54.486109 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-602fbbc4-d234-46ac-a131-5fbd9d4cc169 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:54.487276 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-602fbbc4-d234-46ac-a131-5fbd9d4cc169 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1597 microversion: 2.20 time: 0.160285 Feb 04 18:01:54.487876 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 104/194] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:54 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1597 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:01:54.764592 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-3cae62d8-2483-4a0a-9a5b-1f79548691f1 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "POST /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.952896 Feb 04 18:01:54.765417 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 91/195] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Feb 4 18:01:48 2022] POST /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807/os-volume_attachments => generated 194 bytes in 5955 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:01:55.291919 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-fe1ab4af-b84d-42db-8ddb-e7e5d950ed17 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:55.292529 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-fe1ab4af-b84d-42db-8ddb-e7e5d950ed17 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:55.299026 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fe1ab4af-b84d-42db-8ddb-e7e5d950ed17 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:55.299540 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fe1ab4af-b84d-42db-8ddb-e7e5d950ed17 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:55.300321 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fe1ab4af-b84d-42db-8ddb-e7e5d950ed17 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:55.300752 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fe1ab4af-b84d-42db-8ddb-e7e5d950ed17 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:55.438929 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-fe1ab4af-b84d-42db-8ddb-e7e5d950ed17 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:55.446168 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-fe1ab4af-b84d-42db-8ddb-e7e5d950ed17 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.158390 Feb 04 18:01:55.446773 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 105/196] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:55 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:55.505535 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-f3d6de94-af3b-4fb8-a464-b781fcb09126 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:55.506278 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-f3d6de94-af3b-4fb8-a464-b781fcb09126 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:55.512692 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f3d6de94-af3b-4fb8-a464-b781fcb09126 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:55.513134 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f3d6de94-af3b-4fb8-a464-b781fcb09126 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:55.513924 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f3d6de94-af3b-4fb8-a464-b781fcb09126 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:55.514348 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f3d6de94-af3b-4fb8-a464-b781fcb09126 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:55.646438 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-f3d6de94-af3b-4fb8-a464-b781fcb09126 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:55.654242 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-f3d6de94-af3b-4fb8-a464-b781fcb09126 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:55.655765 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-f3d6de94-af3b-4fb8-a464-b781fcb09126 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:55.657537 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-f3d6de94-af3b-4fb8-a464-b781fcb09126 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1715 microversion: 2.20 time: 0.156153 Feb 04 18:01:55.658100 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 92/197] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:01:55 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1715 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:01:55.674356 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-815fbb80-5eba-4fef-9ad1-89f8f3a073b7 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:55.674878 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-815fbb80-5eba-4fef-9ad1-89f8f3a073b7 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:55.680723 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-815fbb80-5eba-4fef-9ad1-89f8f3a073b7 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:55.681180 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-815fbb80-5eba-4fef-9ad1-89f8f3a073b7 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:55.681955 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-815fbb80-5eba-4fef-9ad1-89f8f3a073b7 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:55.682392 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-815fbb80-5eba-4fef-9ad1-89f8f3a073b7 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:55.705012 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-815fbb80-5eba-4fef-9ad1-89f8f3a073b7 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5/ips" status: 200 len: 149 microversion: 2.20 time: 0.034366 Feb 04 18:01:55.705572 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 106/198] 10.222.0.98 () {60 vars in 1288 bytes} [Fri Feb 4 18:01:55 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 04 18:01:56.463289 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-896b564b-5e11-4329-b063-2f5118a6a457 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:56.463854 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-896b564b-5e11-4329-b063-2f5118a6a457 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:56.469812 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-896b564b-5e11-4329-b063-2f5118a6a457 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:56.470259 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-896b564b-5e11-4329-b063-2f5118a6a457 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:56.474347 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-896b564b-5e11-4329-b063-2f5118a6a457 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:56.474347 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-896b564b-5e11-4329-b063-2f5118a6a457 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:56.616236 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-896b564b-5e11-4329-b063-2f5118a6a457 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:56.623828 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-896b564b-5e11-4329-b063-2f5118a6a457 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.164248 Feb 04 18:01:56.624438 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 93/199] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:56 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:01:57.645658 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-bca7c7b2-a8d5-4804-91a7-ecaac43adbf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:57.652634 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-bca7c7b2-a8d5-4804-91a7-ecaac43adbf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:57.660261 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bca7c7b2-a8d5-4804-91a7-ecaac43adbf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:57.660714 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bca7c7b2-a8d5-4804-91a7-ecaac43adbf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:57.661500 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bca7c7b2-a8d5-4804-91a7-ecaac43adbf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:57.661937 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bca7c7b2-a8d5-4804-91a7-ecaac43adbf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:57.816056 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-bca7c7b2-a8d5-4804-91a7-ecaac43adbf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:57.823462 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-bca7c7b2-a8d5-4804-91a7-ecaac43adbf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.187026 Feb 04 18:01:57.824036 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 107/200] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:57 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:01:58.839240 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b0c4ec4d-13cb-42bc-9ad4-dedda5fe3618 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:01:58.839908 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-b0c4ec4d-13cb-42bc-9ad4-dedda5fe3618 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:01:58.846990 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b0c4ec4d-13cb-42bc-9ad4-dedda5fe3618 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:58.847478 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b0c4ec4d-13cb-42bc-9ad4-dedda5fe3618 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:58.848266 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b0c4ec4d-13cb-42bc-9ad4-dedda5fe3618 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:01:58.848701 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b0c4ec4d-13cb-42bc-9ad4-dedda5fe3618 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:01:59.138807 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-b0c4ec4d-13cb-42bc-9ad4-dedda5fe3618 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:01:59.146956 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b0c4ec4d-13cb-42bc-9ad4-dedda5fe3618 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.311132 Feb 04 18:01:59.147883 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 94/201] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:01:58 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:00.179730 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-74e44e84-42ed-4374-ab37-c8dca6d7e123 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:00.180734 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-74e44e84-42ed-4374-ab37-c8dca6d7e123 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:00.191135 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-74e44e84-42ed-4374-ab37-c8dca6d7e123 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:00.191807 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-74e44e84-42ed-4374-ab37-c8dca6d7e123 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:00.193099 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-74e44e84-42ed-4374-ab37-c8dca6d7e123 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:00.193675 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-74e44e84-42ed-4374-ab37-c8dca6d7e123 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:00.388535 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-74e44e84-42ed-4374-ab37-c8dca6d7e123 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:00.397651 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-74e44e84-42ed-4374-ab37-c8dca6d7e123 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.223938 Feb 04 18:02:00.398272 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 108/202] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:00 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:01.413343 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a26f3e2a-a059-41ba-b4ff-aeb193a8fece tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:01.413951 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-a26f3e2a-a059-41ba-b4ff-aeb193a8fece tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:01.419907 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a26f3e2a-a059-41ba-b4ff-aeb193a8fece tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:01.420369 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a26f3e2a-a059-41ba-b4ff-aeb193a8fece tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:01.421168 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a26f3e2a-a059-41ba-b4ff-aeb193a8fece tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:01.422103 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a26f3e2a-a059-41ba-b4ff-aeb193a8fece tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:01.601041 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-a26f3e2a-a059-41ba-b4ff-aeb193a8fece tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:01.609478 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a26f3e2a-a059-41ba-b4ff-aeb193a8fece tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.199697 Feb 04 18:02:01.610131 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 95/203] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:01 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:02.627049 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-5d4aca1e-7480-45dc-be0d-cc74339cdcbb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:02.627638 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-5d4aca1e-7480-45dc-be0d-cc74339cdcbb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:02.634040 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5d4aca1e-7480-45dc-be0d-cc74339cdcbb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:02.634519 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5d4aca1e-7480-45dc-be0d-cc74339cdcbb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:02.635305 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5d4aca1e-7480-45dc-be0d-cc74339cdcbb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:02.635748 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5d4aca1e-7480-45dc-be0d-cc74339cdcbb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:02.938538 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-5d4aca1e-7480-45dc-be0d-cc74339cdcbb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:02.945874 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-5d4aca1e-7480-45dc-be0d-cc74339cdcbb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.323094 Feb 04 18:02:02.946475 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 109/204] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:02 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:03.964252 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3c0dbd85-6db9-438a-9dae-f58a91d36573 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:03.964953 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-3c0dbd85-6db9-438a-9dae-f58a91d36573 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:03.971819 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3c0dbd85-6db9-438a-9dae-f58a91d36573 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:03.972349 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3c0dbd85-6db9-438a-9dae-f58a91d36573 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:03.973229 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3c0dbd85-6db9-438a-9dae-f58a91d36573 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:03.973791 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3c0dbd85-6db9-438a-9dae-f58a91d36573 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:04.135451 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-3c0dbd85-6db9-438a-9dae-f58a91d36573 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:04.143752 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-3c0dbd85-6db9-438a-9dae-f58a91d36573 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.184075 Feb 04 18:02:04.154214 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 96/205] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:03 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:05.160477 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-83c41110-f32d-4e12-9fb2-6a5bc95f7522 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:05.161089 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-83c41110-f32d-4e12-9fb2-6a5bc95f7522 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:05.167546 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-83c41110-f32d-4e12-9fb2-6a5bc95f7522 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:05.167998 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-83c41110-f32d-4e12-9fb2-6a5bc95f7522 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:05.168820 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-83c41110-f32d-4e12-9fb2-6a5bc95f7522 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:05.169262 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-83c41110-f32d-4e12-9fb2-6a5bc95f7522 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:05.307461 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-83c41110-f32d-4e12-9fb2-6a5bc95f7522 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:05.315601 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-83c41110-f32d-4e12-9fb2-6a5bc95f7522 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.158884 Feb 04 18:02:05.316193 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 110/206] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:05 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:06.332693 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b043f80c-2097-4b87-bccd-657f5269b873 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:06.338362 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-b043f80c-2097-4b87-bccd-657f5269b873 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:06.339952 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b043f80c-2097-4b87-bccd-657f5269b873 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:06.340398 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b043f80c-2097-4b87-bccd-657f5269b873 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:06.341179 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b043f80c-2097-4b87-bccd-657f5269b873 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:06.341616 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b043f80c-2097-4b87-bccd-657f5269b873 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:06.480700 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-b043f80c-2097-4b87-bccd-657f5269b873 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:06.488274 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b043f80c-2097-4b87-bccd-657f5269b873 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.159147 Feb 04 18:02:06.488861 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 97/207] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:06 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:02:07.505884 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-a9abdb76-6aac-4089-87a0-4a60a1089bad tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:07.506609 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-a9abdb76-6aac-4089-87a0-4a60a1089bad tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:07.513095 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a9abdb76-6aac-4089-87a0-4a60a1089bad tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:07.515465 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a9abdb76-6aac-4089-87a0-4a60a1089bad tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:07.515465 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a9abdb76-6aac-4089-87a0-4a60a1089bad tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:07.515838 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a9abdb76-6aac-4089-87a0-4a60a1089bad tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:07.667398 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-a9abdb76-6aac-4089-87a0-4a60a1089bad tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:07.675392 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-a9abdb76-6aac-4089-87a0-4a60a1089bad tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.173269 Feb 04 18:02:07.675961 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 111/208] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:07 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:08.692401 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-83087d66-5c73-4f8d-91c1-4da544e2dfe5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:08.693040 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-83087d66-5c73-4f8d-91c1-4da544e2dfe5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:08.699591 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-83087d66-5c73-4f8d-91c1-4da544e2dfe5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:08.700162 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-83087d66-5c73-4f8d-91c1-4da544e2dfe5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:08.700951 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-83087d66-5c73-4f8d-91c1-4da544e2dfe5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:08.701426 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-83087d66-5c73-4f8d-91c1-4da544e2dfe5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:08.833896 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-83087d66-5c73-4f8d-91c1-4da544e2dfe5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:08.841207 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-83087d66-5c73-4f8d-91c1-4da544e2dfe5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.152483 Feb 04 18:02:08.841781 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 98/209] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:08 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:09.729366 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-1cbcda48-a50e-4b52-b42e-9034cdce7526 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2036861619", "imageRef": "b0fb57f5-967d-4692-94f3-accee37910c3", "flavorRef": "452", "networks": [{"uuid": "3dc2f191-988b-4e16-974b-c84a0b6125d2"}]}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:02:09.781734 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.network.neutron [None req-1cbcda48-a50e-4b52-b42e-9034cdce7526 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] validate_networks() for [('3dc2f191-988b-4e16-974b-c84a0b6125d2', None, None, None, None, None)] {{(pid=123566) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 04 18:02:09.859277 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a161195f-c60c-49ba-a949-a985366af2b3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:09.859828 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-a161195f-c60c-49ba-a949-a985366af2b3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:09.866746 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a161195f-c60c-49ba-a949-a985366af2b3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:09.871740 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a161195f-c60c-49ba-a949-a985366af2b3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:09.871740 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a161195f-c60c-49ba-a949-a985366af2b3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:09.871740 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a161195f-c60c-49ba-a949-a985366af2b3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:10.112057 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-a161195f-c60c-49ba-a949-a985366af2b3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:10.119925 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a161195f-c60c-49ba-a949-a985366af2b3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.264481 Feb 04 18:02:10.127702 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 99/210] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:09 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:02:10.244277 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-1cbcda48-a50e-4b52-b42e-9034cdce7526 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Flavor limits 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 04 18:02:10.244709 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-1cbcda48-a50e-4b52-b42e-9034cdce7526 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Image limits 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 04 18:02:10.245192 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-1cbcda48-a50e-4b52-b42e-9034cdce7526 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Flavor pref 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 04 18:02:10.245608 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-1cbcda48-a50e-4b52-b42e-9034cdce7526 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Image pref 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 04 18:02:10.246024 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-1cbcda48-a50e-4b52-b42e-9034cdce7526 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 04 18:02:10.255282 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1cbcda48-a50e-4b52-b42e-9034cdce7526 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:10.255742 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1cbcda48-a50e-4b52-b42e-9034cdce7526 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:10.256556 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1cbcda48-a50e-4b52-b42e-9034cdce7526 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:10.256994 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1cbcda48-a50e-4b52-b42e-9034cdce7526 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:10.272814 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-1cbcda48-a50e-4b52-b42e-9034cdce7526 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Getting quotas for project c4a8ffd2aaf14a21a0545cb345ab262f. Resources: {'cores', 'ram', 'instances'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:02:10.276754 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-1cbcda48-a50e-4b52-b42e-9034cdce7526 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Getting quotas for user e9bd306bfd5f4867b300ada22547897f and project c4a8ffd2aaf14a21a0545cb345ab262f. Resources: {'cores', 'ram', 'instances'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:02:10.287320 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-1cbcda48-a50e-4b52-b42e-9034cdce7526 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Going to run 1 instances... {{(pid=123566) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 04 18:02:10.289604 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-1cbcda48-a50e-4b52-b42e-9034cdce7526 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0fb57f5-967d-4692-94f3-accee37910c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 04 18:02:10.394641 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-1cbcda48-a50e-4b52-b42e-9034cdce7526 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668921 Feb 04 18:02:10.395209 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 112/211] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Feb 4 18:02:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 04 18:02:10.404883 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-f7f4d757-4a00-422d-a9d1-25d7a67c03d0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:10.405498 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-f7f4d757-4a00-422d-a9d1-25d7a67c03d0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:10.458668 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-f7f4d757-4a00-422d-a9d1-25d7a67c03d0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:10.465147 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-f7f4d757-4a00-422d-a9d1-25d7a67c03d0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1218 microversion: 2.1 time: 0.063966 Feb 04 18:02:10.465725 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 100/212] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:10 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:11.137789 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-575432d0-2061-4f45-bcae-6db5497022da tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:11.138406 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-575432d0-2061-4f45-bcae-6db5497022da tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:11.145790 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-575432d0-2061-4f45-bcae-6db5497022da tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:11.146561 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-575432d0-2061-4f45-bcae-6db5497022da tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:11.147047 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-575432d0-2061-4f45-bcae-6db5497022da tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:11.147491 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-575432d0-2061-4f45-bcae-6db5497022da tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:11.290853 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-575432d0-2061-4f45-bcae-6db5497022da tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:11.298650 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-575432d0-2061-4f45-bcae-6db5497022da tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.164865 Feb 04 18:02:11.299406 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 113/213] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:11 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:11.481950 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-fdc3cb14-b81c-4391-8e3b-eccc8adb77b1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:11.482600 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-fdc3cb14-b81c-4391-8e3b-eccc8adb77b1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:11.489415 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fdc3cb14-b81c-4391-8e3b-eccc8adb77b1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:11.489859 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fdc3cb14-b81c-4391-8e3b-eccc8adb77b1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:11.490663 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fdc3cb14-b81c-4391-8e3b-eccc8adb77b1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:11.491098 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fdc3cb14-b81c-4391-8e3b-eccc8adb77b1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:11.551626 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-fdc3cb14-b81c-4391-8e3b-eccc8adb77b1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:11.558783 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-fdc3cb14-b81c-4391-8e3b-eccc8adb77b1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1222 microversion: 2.1 time: 0.080355 Feb 04 18:02:11.559352 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 101/214] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:11 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:12.315047 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-dd4cbab0-376a-4bd1-b45d-d7b602eee26b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:12.315776 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-dd4cbab0-376a-4bd1-b45d-d7b602eee26b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:12.322117 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dd4cbab0-376a-4bd1-b45d-d7b602eee26b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:12.322686 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dd4cbab0-376a-4bd1-b45d-d7b602eee26b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:12.323472 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dd4cbab0-376a-4bd1-b45d-d7b602eee26b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:12.323901 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dd4cbab0-376a-4bd1-b45d-d7b602eee26b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:12.453616 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-dd4cbab0-376a-4bd1-b45d-d7b602eee26b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:12.460893 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-dd4cbab0-376a-4bd1-b45d-d7b602eee26b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.150102 Feb 04 18:02:12.461476 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 114/215] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:12 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:12.575372 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-1aa47f7e-a44d-4417-92fc-88218dc89a49 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:12.575988 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-1aa47f7e-a44d-4417-92fc-88218dc89a49 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:12.582260 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1aa47f7e-a44d-4417-92fc-88218dc89a49 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:12.582743 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1aa47f7e-a44d-4417-92fc-88218dc89a49 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:12.583525 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1aa47f7e-a44d-4417-92fc-88218dc89a49 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:12.583968 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1aa47f7e-a44d-4417-92fc-88218dc89a49 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:12.647237 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-1aa47f7e-a44d-4417-92fc-88218dc89a49 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:12.654542 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-1aa47f7e-a44d-4417-92fc-88218dc89a49 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1222 microversion: 2.1 time: 0.082792 Feb 04 18:02:12.655168 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 102/216] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:12 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:13.477336 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-56dbfd53-88bb-42bc-bb2c-146d80f0c6a6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:13.477986 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-56dbfd53-88bb-42bc-bb2c-146d80f0c6a6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:13.484946 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-56dbfd53-88bb-42bc-bb2c-146d80f0c6a6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:13.485412 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-56dbfd53-88bb-42bc-bb2c-146d80f0c6a6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:13.486235 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-56dbfd53-88bb-42bc-bb2c-146d80f0c6a6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:13.486696 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-56dbfd53-88bb-42bc-bb2c-146d80f0c6a6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:13.620040 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-56dbfd53-88bb-42bc-bb2c-146d80f0c6a6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:13.627324 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-56dbfd53-88bb-42bc-bb2c-146d80f0c6a6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.153670 Feb 04 18:02:13.627893 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 115/217] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:13 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:13.670857 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3eff8569-a18f-4ebb-8918-ab568e046202 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:13.672011 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-3eff8569-a18f-4ebb-8918-ab568e046202 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:13.678253 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3eff8569-a18f-4ebb-8918-ab568e046202 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:13.678787 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3eff8569-a18f-4ebb-8918-ab568e046202 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:13.679572 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3eff8569-a18f-4ebb-8918-ab568e046202 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:13.680014 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3eff8569-a18f-4ebb-8918-ab568e046202 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:13.738935 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-3eff8569-a18f-4ebb-8918-ab568e046202 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:13.746010 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-3eff8569-a18f-4ebb-8918-ab568e046202 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1222 microversion: 2.1 time: 0.078813 Feb 04 18:02:13.746617 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 103/218] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:13 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:14.644243 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-d193cabe-d519-493f-b2cd-5114c617e1d3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:14.644847 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-d193cabe-d519-493f-b2cd-5114c617e1d3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:14.651126 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d193cabe-d519-493f-b2cd-5114c617e1d3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:14.651549 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d193cabe-d519-493f-b2cd-5114c617e1d3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:14.652318 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d193cabe-d519-493f-b2cd-5114c617e1d3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:14.652747 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d193cabe-d519-493f-b2cd-5114c617e1d3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:14.761945 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-055c64a3-b2bd-4961-a8fb-768559f438a0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:14.762584 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-055c64a3-b2bd-4961-a8fb-768559f438a0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:14.769182 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-055c64a3-b2bd-4961-a8fb-768559f438a0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:14.769626 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-055c64a3-b2bd-4961-a8fb-768559f438a0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:14.770396 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-055c64a3-b2bd-4961-a8fb-768559f438a0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:14.770853 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-055c64a3-b2bd-4961-a8fb-768559f438a0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:14.787689 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-d193cabe-d519-493f-b2cd-5114c617e1d3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:14.795133 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-d193cabe-d519-493f-b2cd-5114c617e1d3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.154424 Feb 04 18:02:14.795722 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 116/219] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:14 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:14.829733 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-055c64a3-b2bd-4961-a8fb-768559f438a0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:14.837357 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-055c64a3-b2bd-4961-a8fb-768559f438a0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1222 microversion: 2.1 time: 0.078932 Feb 04 18:02:14.837943 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 104/220] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:14 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:02:15.812316 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-4c75fb46-4f72-4fe9-95b0-c4c731b18623 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:15.812968 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-4c75fb46-4f72-4fe9-95b0-c4c731b18623 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:15.819268 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4c75fb46-4f72-4fe9-95b0-c4c731b18623 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:15.819713 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4c75fb46-4f72-4fe9-95b0-c4c731b18623 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:15.820485 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4c75fb46-4f72-4fe9-95b0-c4c731b18623 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:15.820917 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4c75fb46-4f72-4fe9-95b0-c4c731b18623 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:15.854362 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-4462095f-d29d-4a8d-ac39-b28f2af00514 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:15.855198 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-4462095f-d29d-4a8d-ac39-b28f2af00514 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:15.861802 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4462095f-d29d-4a8d-ac39-b28f2af00514 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:15.862255 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4462095f-d29d-4a8d-ac39-b28f2af00514 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:15.863180 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4462095f-d29d-4a8d-ac39-b28f2af00514 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:15.863886 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4462095f-d29d-4a8d-ac39-b28f2af00514 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:15.933576 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-4462095f-d29d-4a8d-ac39-b28f2af00514 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:15.941384 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-4462095f-d29d-4a8d-ac39-b28f2af00514 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1222 microversion: 2.1 time: 0.090697 Feb 04 18:02:15.942084 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 105/221] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:15 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:02:15.975459 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-4c75fb46-4f72-4fe9-95b0-c4c731b18623 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:15.982558 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-4c75fb46-4f72-4fe9-95b0-c4c731b18623 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.174409 Feb 04 18:02:15.983117 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 117/222] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:15 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:16.958544 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-8a5f0f98-dbf6-4280-b046-f2121bd61e0d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:16.959198 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-8a5f0f98-dbf6-4280-b046-f2121bd61e0d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:16.966341 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8a5f0f98-dbf6-4280-b046-f2121bd61e0d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:16.966828 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8a5f0f98-dbf6-4280-b046-f2121bd61e0d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:16.968176 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8a5f0f98-dbf6-4280-b046-f2121bd61e0d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:16.968621 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8a5f0f98-dbf6-4280-b046-f2121bd61e0d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:16.999291 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-6adb5528-6c97-4140-b4e1-40de5497c672 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:17.000060 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-6adb5528-6c97-4140-b4e1-40de5497c672 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:17.006393 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6adb5528-6c97-4140-b4e1-40de5497c672 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:17.006991 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6adb5528-6c97-4140-b4e1-40de5497c672 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:17.008084 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6adb5528-6c97-4140-b4e1-40de5497c672 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:17.008671 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6adb5528-6c97-4140-b4e1-40de5497c672 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:17.029575 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-8a5f0f98-dbf6-4280-b046-f2121bd61e0d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:17.037619 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-8a5f0f98-dbf6-4280-b046-f2121bd61e0d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1214 microversion: 2.1 time: 0.082757 Feb 04 18:02:17.038195 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 106/223] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:16 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:17.153266 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-6adb5528-6c97-4140-b4e1-40de5497c672 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:17.161441 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-6adb5528-6c97-4140-b4e1-40de5497c672 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.165733 Feb 04 18:02:17.162088 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 118/224] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:16 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:18.054988 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-9e8fedc1-285d-4f95-ae9d-87bfac63dc44 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:18.055771 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-9e8fedc1-285d-4f95-ae9d-87bfac63dc44 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:18.062883 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9e8fedc1-285d-4f95-ae9d-87bfac63dc44 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:18.063433 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9e8fedc1-285d-4f95-ae9d-87bfac63dc44 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:18.064244 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9e8fedc1-285d-4f95-ae9d-87bfac63dc44 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:18.064685 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9e8fedc1-285d-4f95-ae9d-87bfac63dc44 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:18.130395 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-9e8fedc1-285d-4f95-ae9d-87bfac63dc44 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:18.137886 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-9e8fedc1-285d-4f95-ae9d-87bfac63dc44 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1270 microversion: 2.1 time: 0.086743 Feb 04 18:02:18.138482 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 107/225] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:18 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:18.178358 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-9b2d1973-3c70-44ee-a57b-4b51bd8420d3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:18.178950 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-9b2d1973-3c70-44ee-a57b-4b51bd8420d3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:18.192741 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9b2d1973-3c70-44ee-a57b-4b51bd8420d3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:18.192741 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9b2d1973-3c70-44ee-a57b-4b51bd8420d3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:18.192741 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9b2d1973-3c70-44ee-a57b-4b51bd8420d3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:18.192741 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9b2d1973-3c70-44ee-a57b-4b51bd8420d3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:18.324306 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-9b2d1973-3c70-44ee-a57b-4b51bd8420d3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:18.331865 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-9b2d1973-3c70-44ee-a57b-4b51bd8420d3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.157196 Feb 04 18:02:18.332444 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 119/226] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:18 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:02:19.154447 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-cc378d77-9d71-4329-9f5a-42cf1c1d831a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:19.155098 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-cc378d77-9d71-4329-9f5a-42cf1c1d831a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:19.161194 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cc378d77-9d71-4329-9f5a-42cf1c1d831a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:19.161650 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cc378d77-9d71-4329-9f5a-42cf1c1d831a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:19.162460 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cc378d77-9d71-4329-9f5a-42cf1c1d831a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:19.162906 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cc378d77-9d71-4329-9f5a-42cf1c1d831a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:19.292683 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-cc378d77-9d71-4329-9f5a-42cf1c1d831a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:19.300432 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-cc378d77-9d71-4329-9f5a-42cf1c1d831a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1318 microversion: 2.1 time: 0.149612 Feb 04 18:02:19.301006 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 108/227] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:19 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:19.348445 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-85cd64af-9a2d-4a0d-b929-3ed8ace793a4 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:19.349053 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-85cd64af-9a2d-4a0d-b929-3ed8ace793a4 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:19.355368 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-85cd64af-9a2d-4a0d-b929-3ed8ace793a4 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:19.355817 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-85cd64af-9a2d-4a0d-b929-3ed8ace793a4 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:19.356591 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-85cd64af-9a2d-4a0d-b929-3ed8ace793a4 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:19.357034 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-85cd64af-9a2d-4a0d-b929-3ed8ace793a4 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:19.492096 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-85cd64af-9a2d-4a0d-b929-3ed8ace793a4 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:19.499502 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-85cd64af-9a2d-4a0d-b929-3ed8ace793a4 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.154754 Feb 04 18:02:19.500073 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 120/228] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:19 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:20.317165 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-757a9793-f1d3-4525-9779-adf5a31d25c8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:20.317775 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-757a9793-f1d3-4525-9779-adf5a31d25c8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:20.324017 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-757a9793-f1d3-4525-9779-adf5a31d25c8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:20.324469 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-757a9793-f1d3-4525-9779-adf5a31d25c8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:20.325254 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-757a9793-f1d3-4525-9779-adf5a31d25c8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:20.325695 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-757a9793-f1d3-4525-9779-adf5a31d25c8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:20.456746 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-757a9793-f1d3-4525-9779-adf5a31d25c8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:20.464075 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-757a9793-f1d3-4525-9779-adf5a31d25c8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1318 microversion: 2.1 time: 0.150611 Feb 04 18:02:20.464644 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 109/229] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:20 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:20.516711 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-97054e31-6894-4ad6-b046-0912586b212c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:20.517247 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-97054e31-6894-4ad6-b046-0912586b212c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:20.523545 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-97054e31-6894-4ad6-b046-0912586b212c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:20.523995 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-97054e31-6894-4ad6-b046-0912586b212c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:20.524771 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-97054e31-6894-4ad6-b046-0912586b212c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:20.525209 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-97054e31-6894-4ad6-b046-0912586b212c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:20.663057 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-97054e31-6894-4ad6-b046-0912586b212c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:20.671136 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-97054e31-6894-4ad6-b046-0912586b212c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.158199 Feb 04 18:02:20.671722 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 121/230] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:20 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:21.480811 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-65f17303-83ec-488f-adb2-42146a04db60 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:21.481445 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-65f17303-83ec-488f-adb2-42146a04db60 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:21.487693 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-65f17303-83ec-488f-adb2-42146a04db60 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:21.488149 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-65f17303-83ec-488f-adb2-42146a04db60 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:21.489191 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-65f17303-83ec-488f-adb2-42146a04db60 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:21.489628 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-65f17303-83ec-488f-adb2-42146a04db60 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:21.617415 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-65f17303-83ec-488f-adb2-42146a04db60 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:21.624638 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-65f17303-83ec-488f-adb2-42146a04db60 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1318 microversion: 2.1 time: 0.147525 Feb 04 18:02:21.625239 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 110/231] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:21 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:21.688332 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-5c3fcd2b-4345-426b-b810-611fbf8ce4fa tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:21.688990 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-5c3fcd2b-4345-426b-b810-611fbf8ce4fa tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:21.695835 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5c3fcd2b-4345-426b-b810-611fbf8ce4fa tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:21.696282 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5c3fcd2b-4345-426b-b810-611fbf8ce4fa tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:21.697072 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5c3fcd2b-4345-426b-b810-611fbf8ce4fa tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:21.697501 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5c3fcd2b-4345-426b-b810-611fbf8ce4fa tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:21.831547 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-5c3fcd2b-4345-426b-b810-611fbf8ce4fa tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:21.839300 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-5c3fcd2b-4345-426b-b810-611fbf8ce4fa tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.155096 Feb 04 18:02:21.839890 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 122/232] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:21 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:22.427447 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-a1b1417e-3669-4cc7-9e04-94af7371e94e req-5c78979b-7bbe-47fd-ae8e-77730cf502e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11825ca5-07bd-404f-8133-569adcfb9de0", "tag": "d402aa33-a7fe-42e3-b2c8-eb33d0501272"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:02:22.429020 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:02:22.429020 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:02:22.436573 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-a1b1417e-3669-4cc7-9e04-94af7371e94e req-5c78979b-7bbe-47fd-ae8e-77730cf502e2 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:22.437031 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-a1b1417e-3669-4cc7-9e04-94af7371e94e req-5c78979b-7bbe-47fd-ae8e-77730cf502e2 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:22.448172 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-a1b1417e-3669-4cc7-9e04-94af7371e94e req-5c78979b-7bbe-47fd-ae8e-77730cf502e2 service nova] Creating event network-changed:d402aa33-a7fe-42e3-b2c8-eb33d0501272 for instance 11825ca5-07bd-404f-8133-569adcfb9de0 on hv-cinder-82276 Feb 04 18:02:22.453189 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-a1b1417e-3669-4cc7-9e04-94af7371e94e req-5c78979b-7bbe-47fd-ae8e-77730cf502e2 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029304 Feb 04 18:02:22.453790 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 111/233] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:02:22.641052 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-277b8b7d-8575-4192-a22b-2d1cf900b10a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:22.641577 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-277b8b7d-8575-4192-a22b-2d1cf900b10a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:22.647504 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-277b8b7d-8575-4192-a22b-2d1cf900b10a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:22.647950 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-277b8b7d-8575-4192-a22b-2d1cf900b10a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:22.648717 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-277b8b7d-8575-4192-a22b-2d1cf900b10a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:22.649153 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-277b8b7d-8575-4192-a22b-2d1cf900b10a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:22.784559 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-277b8b7d-8575-4192-a22b-2d1cf900b10a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:22.791667 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-277b8b7d-8575-4192-a22b-2d1cf900b10a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1318 microversion: 2.1 time: 0.154397 Feb 04 18:02:22.792241 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 123/234] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:22 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:22.856698 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-d9471301-3ba0-42ec-a720-7c095d59433a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:22.857398 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-d9471301-3ba0-42ec-a720-7c095d59433a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:22.864274 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d9471301-3ba0-42ec-a720-7c095d59433a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:22.864760 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d9471301-3ba0-42ec-a720-7c095d59433a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:22.865539 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d9471301-3ba0-42ec-a720-7c095d59433a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:22.866006 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d9471301-3ba0-42ec-a720-7c095d59433a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:22.997374 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-d9471301-3ba0-42ec-a720-7c095d59433a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:23.004970 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-d9471301-3ba0-42ec-a720-7c095d59433a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.152372 Feb 04 18:02:23.005554 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 112/235] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:22 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:23.809165 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-22e3e51e-ca51-48ef-937a-9dcae829c7b2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:23.809764 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-22e3e51e-ca51-48ef-937a-9dcae829c7b2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:23.816768 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-22e3e51e-ca51-48ef-937a-9dcae829c7b2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:23.817222 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-22e3e51e-ca51-48ef-937a-9dcae829c7b2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:23.818007 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-22e3e51e-ca51-48ef-937a-9dcae829c7b2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:23.818466 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-22e3e51e-ca51-48ef-937a-9dcae829c7b2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:23.953252 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-22e3e51e-ca51-48ef-937a-9dcae829c7b2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:23.960437 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-22e3e51e-ca51-48ef-937a-9dcae829c7b2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1318 microversion: 2.1 time: 0.154936 Feb 04 18:02:23.961006 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 124/236] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:23 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:24.022196 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-d4502694-254c-4b7a-b680-c73e21ec703a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:24.022836 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-d4502694-254c-4b7a-b680-c73e21ec703a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:24.029057 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d4502694-254c-4b7a-b680-c73e21ec703a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:24.030064 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d4502694-254c-4b7a-b680-c73e21ec703a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:24.030874 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d4502694-254c-4b7a-b680-c73e21ec703a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:24.031321 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d4502694-254c-4b7a-b680-c73e21ec703a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:24.161637 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-d4502694-254c-4b7a-b680-c73e21ec703a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:24.168993 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-d4502694-254c-4b7a-b680-c73e21ec703a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.150516 Feb 04 18:02:24.169586 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 113/237] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:24 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:24.977213 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-fdf8115a-fbfe-4876-bc3a-eb17e69cf790 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:24.977813 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-fdf8115a-fbfe-4876-bc3a-eb17e69cf790 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:24.984936 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fdf8115a-fbfe-4876-bc3a-eb17e69cf790 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:24.985380 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fdf8115a-fbfe-4876-bc3a-eb17e69cf790 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:24.986182 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fdf8115a-fbfe-4876-bc3a-eb17e69cf790 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:24.986648 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fdf8115a-fbfe-4876-bc3a-eb17e69cf790 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:25.126875 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-fdf8115a-fbfe-4876-bc3a-eb17e69cf790 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:25.137968 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-fdf8115a-fbfe-4876-bc3a-eb17e69cf790 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1318 microversion: 2.1 time: 0.164216 Feb 04 18:02:25.147762 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 125/238] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:24 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:25.186118 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-905f0010-0cc7-490d-a996-dc58478d33bb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:25.186856 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-905f0010-0cc7-490d-a996-dc58478d33bb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:25.193362 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-905f0010-0cc7-490d-a996-dc58478d33bb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:25.193819 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-905f0010-0cc7-490d-a996-dc58478d33bb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:25.194662 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-905f0010-0cc7-490d-a996-dc58478d33bb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:25.195106 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-905f0010-0cc7-490d-a996-dc58478d33bb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:25.331008 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-905f0010-0cc7-490d-a996-dc58478d33bb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:25.338602 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-905f0010-0cc7-490d-a996-dc58478d33bb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.156063 Feb 04 18:02:25.339498 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 114/239] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:25 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:26.155499 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-08e1c31a-786c-4f3f-ae19-15095a4ae4c1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:26.156115 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-08e1c31a-786c-4f3f-ae19-15095a4ae4c1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:26.162465 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-08e1c31a-786c-4f3f-ae19-15095a4ae4c1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:26.162929 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-08e1c31a-786c-4f3f-ae19-15095a4ae4c1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:26.163725 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-08e1c31a-786c-4f3f-ae19-15095a4ae4c1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:26.164161 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-08e1c31a-786c-4f3f-ae19-15095a4ae4c1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:26.295994 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-08e1c31a-786c-4f3f-ae19-15095a4ae4c1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:26.303440 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-08e1c31a-786c-4f3f-ae19-15095a4ae4c1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1318 microversion: 2.1 time: 0.152163 Feb 04 18:02:26.304069 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 126/240] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:26 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:26.356087 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-716d9ed5-d450-4774-ab40-45da47efd84c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:26.356698 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-716d9ed5-d450-4774-ab40-45da47efd84c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:26.363873 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-716d9ed5-d450-4774-ab40-45da47efd84c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:26.364362 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-716d9ed5-d450-4774-ab40-45da47efd84c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:26.365130 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-716d9ed5-d450-4774-ab40-45da47efd84c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:26.365609 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-716d9ed5-d450-4774-ab40-45da47efd84c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:26.502844 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-716d9ed5-d450-4774-ab40-45da47efd84c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:26.510444 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-716d9ed5-d450-4774-ab40-45da47efd84c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.157948 Feb 04 18:02:26.511076 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 115/241] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:26 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:27.321265 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-bec4963e-ddb4-4120-b8e3-89193622aae7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:27.321950 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-bec4963e-ddb4-4120-b8e3-89193622aae7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:27.329411 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bec4963e-ddb4-4120-b8e3-89193622aae7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:27.329855 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bec4963e-ddb4-4120-b8e3-89193622aae7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:27.330848 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bec4963e-ddb4-4120-b8e3-89193622aae7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:27.331291 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bec4963e-ddb4-4120-b8e3-89193622aae7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:27.467692 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-bec4963e-ddb4-4120-b8e3-89193622aae7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:27.475020 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-bec4963e-ddb4-4120-b8e3-89193622aae7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1318 microversion: 2.1 time: 0.157759 Feb 04 18:02:27.475620 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 127/242] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:27 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:27.528355 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-8521834c-c7c8-43a7-bf8b-08cfa4aabac0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:27.529094 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-8521834c-c7c8-43a7-bf8b-08cfa4aabac0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:27.538498 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8521834c-c7c8-43a7-bf8b-08cfa4aabac0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:27.538498 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8521834c-c7c8-43a7-bf8b-08cfa4aabac0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:27.538498 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8521834c-c7c8-43a7-bf8b-08cfa4aabac0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:27.538498 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8521834c-c7c8-43a7-bf8b-08cfa4aabac0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:27.673844 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-8521834c-c7c8-43a7-bf8b-08cfa4aabac0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:27.681465 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-8521834c-c7c8-43a7-bf8b-08cfa4aabac0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.156875 Feb 04 18:02:27.682043 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 116/243] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:27 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:28.491899 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-d94c8895-d0c1-4b05-8258-e4b671be0448 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:28.492497 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-d94c8895-d0c1-4b05-8258-e4b671be0448 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:28.499378 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d94c8895-d0c1-4b05-8258-e4b671be0448 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:28.499830 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d94c8895-d0c1-4b05-8258-e4b671be0448 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:28.504137 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d94c8895-d0c1-4b05-8258-e4b671be0448 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:28.504137 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d94c8895-d0c1-4b05-8258-e4b671be0448 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:28.645735 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-d94c8895-d0c1-4b05-8258-e4b671be0448 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:28.653298 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-d94c8895-d0c1-4b05-8258-e4b671be0448 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1318 microversion: 2.1 time: 0.165318 Feb 04 18:02:28.653878 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 128/244] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:28 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:28.708031 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-f20b4b4c-95c0-4106-a7a7-1d16b5025f64 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:28.708900 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-f20b4b4c-95c0-4106-a7a7-1d16b5025f64 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:28.715822 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f20b4b4c-95c0-4106-a7a7-1d16b5025f64 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:28.716282 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f20b4b4c-95c0-4106-a7a7-1d16b5025f64 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:28.717141 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f20b4b4c-95c0-4106-a7a7-1d16b5025f64 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:28.717588 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f20b4b4c-95c0-4106-a7a7-1d16b5025f64 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:28.866632 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-f20b4b4c-95c0-4106-a7a7-1d16b5025f64 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:28.875133 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-f20b4b4c-95c0-4106-a7a7-1d16b5025f64 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.173725 Feb 04 18:02:28.875737 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 117/245] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:28 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:29.669552 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-dbe88063-25ce-4b2d-a108-42fe99442c3e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:29.670228 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-dbe88063-25ce-4b2d-a108-42fe99442c3e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:29.676465 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dbe88063-25ce-4b2d-a108-42fe99442c3e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:29.676908 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dbe88063-25ce-4b2d-a108-42fe99442c3e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:29.677679 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dbe88063-25ce-4b2d-a108-42fe99442c3e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:29.678109 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dbe88063-25ce-4b2d-a108-42fe99442c3e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:29.819214 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-dbe88063-25ce-4b2d-a108-42fe99442c3e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:29.827350 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-dbe88063-25ce-4b2d-a108-42fe99442c3e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1318 microversion: 2.1 time: 0.161454 Feb 04 18:02:29.827922 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 129/246] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:29 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:29.892960 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-05fc7cfa-a728-4582-8819-131b23b80618 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:29.893715 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-05fc7cfa-a728-4582-8819-131b23b80618 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:29.900452 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-05fc7cfa-a728-4582-8819-131b23b80618 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:29.900901 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-05fc7cfa-a728-4582-8819-131b23b80618 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:29.901726 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-05fc7cfa-a728-4582-8819-131b23b80618 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:29.902209 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-05fc7cfa-a728-4582-8819-131b23b80618 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:30.041617 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-05fc7cfa-a728-4582-8819-131b23b80618 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:30.049419 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-05fc7cfa-a728-4582-8819-131b23b80618 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.161002 Feb 04 18:02:30.050001 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 118/247] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:29 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:30.844310 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-f9c73272-346e-4adf-8abb-b8903c50890b tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:30.845100 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-f9c73272-346e-4adf-8abb-b8903c50890b tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:30.853192 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f9c73272-346e-4adf-8abb-b8903c50890b tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:30.853732 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f9c73272-346e-4adf-8abb-b8903c50890b tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:30.854623 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f9c73272-346e-4adf-8abb-b8903c50890b tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:30.855310 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f9c73272-346e-4adf-8abb-b8903c50890b tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:31.017722 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-f9c73272-346e-4adf-8abb-b8903c50890b tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:31.017722 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-f9c73272-346e-4adf-8abb-b8903c50890b tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1318 microversion: 2.1 time: 0.174988 Feb 04 18:02:31.017722 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 130/248] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:30 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:31.069560 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-331fb107-5bce-4dfd-a496-6d4e15c949d4 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:31.075130 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-331fb107-5bce-4dfd-a496-6d4e15c949d4 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:31.077731 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-331fb107-5bce-4dfd-a496-6d4e15c949d4 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:31.078166 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-331fb107-5bce-4dfd-a496-6d4e15c949d4 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:31.079000 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-331fb107-5bce-4dfd-a496-6d4e15c949d4 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:31.079451 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-331fb107-5bce-4dfd-a496-6d4e15c949d4 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:31.232030 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-331fb107-5bce-4dfd-a496-6d4e15c949d4 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:31.240676 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-331fb107-5bce-4dfd-a496-6d4e15c949d4 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.174749 Feb 04 18:02:31.241256 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 119/249] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:31 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:32.032540 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-c592e952-b721-4051-b986-92f77e2891f7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:32.033147 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-c592e952-b721-4051-b986-92f77e2891f7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:32.039895 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c592e952-b721-4051-b986-92f77e2891f7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:32.041531 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c592e952-b721-4051-b986-92f77e2891f7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:32.042522 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c592e952-b721-4051-b986-92f77e2891f7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:32.043182 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c592e952-b721-4051-b986-92f77e2891f7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:32.257685 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-db962f95-4321-46bd-9b78-365ed516437e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:32.258583 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-db962f95-4321-46bd-9b78-365ed516437e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:32.266944 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-db962f95-4321-46bd-9b78-365ed516437e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:32.267626 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-db962f95-4321-46bd-9b78-365ed516437e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:32.268731 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-db962f95-4321-46bd-9b78-365ed516437e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:32.269350 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-db962f95-4321-46bd-9b78-365ed516437e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:32.300599 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c592e952-b721-4051-b986-92f77e2891f7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:32.311017 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-c592e952-b721-4051-b986-92f77e2891f7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1318 microversion: 2.1 time: 0.282063 Feb 04 18:02:32.311617 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 131/250] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:32 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:02:32.792584 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-db962f95-4321-46bd-9b78-365ed516437e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:32.800191 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-db962f95-4321-46bd-9b78-365ed516437e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1523 microversion: 2.1 time: 0.546374 Feb 04 18:02:32.800768 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 120/251] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:32 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1523 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:02:33.328710 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-2c479358-ee1f-4e08-8cc8-c01660ff8a33 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:33.329419 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-2c479358-ee1f-4e08-8cc8-c01660ff8a33 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:33.340841 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2c479358-ee1f-4e08-8cc8-c01660ff8a33 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:33.341375 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2c479358-ee1f-4e08-8cc8-c01660ff8a33 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:33.342820 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2c479358-ee1f-4e08-8cc8-c01660ff8a33 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:33.343978 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2c479358-ee1f-4e08-8cc8-c01660ff8a33 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:33.483613 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2c479358-ee1f-4e08-8cc8-c01660ff8a33 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:33.493535 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-2c479358-ee1f-4e08-8cc8-c01660ff8a33 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1318 microversion: 2.1 time: 0.169377 Feb 04 18:02:33.494728 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 132/252] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:33 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:33.816801 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-829f618e-ce4c-470f-a12f-4b55cfc9d280 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:33.817407 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-829f618e-ce4c-470f-a12f-4b55cfc9d280 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:33.823689 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-829f618e-ce4c-470f-a12f-4b55cfc9d280 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:33.824140 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-829f618e-ce4c-470f-a12f-4b55cfc9d280 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:33.838649 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-829f618e-ce4c-470f-a12f-4b55cfc9d280 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:33.838649 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-829f618e-ce4c-470f-a12f-4b55cfc9d280 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:33.977603 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-829f618e-ce4c-470f-a12f-4b55cfc9d280 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:33.980140 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-829f618e-ce4c-470f-a12f-4b55cfc9d280 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1503 microversion: 2.1 time: 0.166932 Feb 04 18:02:33.980796 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 121/253] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:33 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:33.997181 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-07d6acf7-e3de-4f0f-a24b-a3aa2ea23064 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:33.998355 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-07d6acf7-e3de-4f0f-a24b-a3aa2ea23064 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:34.004366 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-07d6acf7-e3de-4f0f-a24b-a3aa2ea23064 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:34.004814 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-07d6acf7-e3de-4f0f-a24b-a3aa2ea23064 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:34.005651 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-07d6acf7-e3de-4f0f-a24b-a3aa2ea23064 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:34.006080 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-07d6acf7-e3de-4f0f-a24b-a3aa2ea23064 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:34.231459 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-07d6acf7-e3de-4f0f-a24b-a3aa2ea23064 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:34.237012 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-07d6acf7-e3de-4f0f-a24b-a3aa2ea23064 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1516 microversion: 2.1 time: 0.243519 Feb 04 18:02:34.239032 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 133/254] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:33 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1516 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:34.514863 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-52fb8f4c-3ace-4367-9645-5a70e3b1d748 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:34.517044 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-52fb8f4c-3ace-4367-9645-5a70e3b1d748 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:34.527890 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-52fb8f4c-3ace-4367-9645-5a70e3b1d748 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:34.530316 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-52fb8f4c-3ace-4367-9645-5a70e3b1d748 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:34.531202 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-52fb8f4c-3ace-4367-9645-5a70e3b1d748 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:34.531653 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-52fb8f4c-3ace-4367-9645-5a70e3b1d748 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:34.803314 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-52fb8f4c-3ace-4367-9645-5a70e3b1d748 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:34.812918 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-52fb8f4c-3ace-4367-9645-5a70e3b1d748 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1318 microversion: 2.1 time: 0.305295 Feb 04 18:02:34.813888 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 122/255] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:34 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:35.833839 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-f332132a-8f0b-4b64-a420-be1643dc57a3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:35.834912 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-f332132a-8f0b-4b64-a420-be1643dc57a3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:35.843325 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f332132a-8f0b-4b64-a420-be1643dc57a3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:35.843962 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f332132a-8f0b-4b64-a420-be1643dc57a3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:35.844860 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f332132a-8f0b-4b64-a420-be1643dc57a3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:35.845455 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f332132a-8f0b-4b64-a420-be1643dc57a3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:35.994049 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-f332132a-8f0b-4b64-a420-be1643dc57a3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:36.002141 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-f332132a-8f0b-4b64-a420-be1643dc57a3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1318 microversion: 2.1 time: 0.173845 Feb 04 18:02:36.002856 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 134/256] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:35 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:36.525350 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-14b9bc0c-70ff-4340-b48a-8b50b4af35b8 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:36.526645 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-14b9bc0c-70ff-4340-b48a-8b50b4af35b8 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:36.535177 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-14b9bc0c-70ff-4340-b48a-8b50b4af35b8 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:36.535633 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-14b9bc0c-70ff-4340-b48a-8b50b4af35b8 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:36.536761 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-14b9bc0c-70ff-4340-b48a-8b50b4af35b8 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:36.537361 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-14b9bc0c-70ff-4340-b48a-8b50b4af35b8 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:36.568493 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-14b9bc0c-70ff-4340-b48a-8b50b4af35b8 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Going to try to terminate instance {{(pid=123567) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 04 18:02:36.889985 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-14b9bc0c-70ff-4340-b48a-8b50b4af35b8 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "DELETE /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 204 len: 0 microversion: 2.1 time: 0.368586 Feb 04 18:02:36.891508 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 123/257] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Feb 4 18:02:36 2022] DELETE /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 04 18:02:36.898907 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-feb7862b-9173-4bb4-89d3-cf8ef5554674 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:36.899637 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-feb7862b-9173-4bb4-89d3-cf8ef5554674 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:36.906385 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-feb7862b-9173-4bb4-89d3-cf8ef5554674 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:36.907077 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-feb7862b-9173-4bb4-89d3-cf8ef5554674 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:36.908213 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-feb7862b-9173-4bb4-89d3-cf8ef5554674 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:36.909057 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-feb7862b-9173-4bb4-89d3-cf8ef5554674 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:37.020270 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-2c561cff-89c0-48c3-9e70-812c394741df tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:37.021142 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-2c561cff-89c0-48c3-9e70-812c394741df tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:37.027118 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2c561cff-89c0-48c3-9e70-812c394741df tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:37.027640 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2c561cff-89c0-48c3-9e70-812c394741df tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:37.031238 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2c561cff-89c0-48c3-9e70-812c394741df tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:37.031238 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2c561cff-89c0-48c3-9e70-812c394741df tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:37.049512 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-feb7862b-9173-4bb4-89d3-cf8ef5554674 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:37.062187 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-feb7862b-9173-4bb4-89d3-cf8ef5554674 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1553 microversion: 2.1 time: 0.167151 Feb 04 18:02:37.072039 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 135/258] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:36 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1553 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:37.122460 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-87f28780-b6e9-4a3a-9838-2576cd138757 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:02:37.124853 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-87f28780-b6e9-4a3a-9838-2576cd138757 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:37.130535 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-87f28780-b6e9-4a3a-9838-2576cd138757 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:37.130987 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-87f28780-b6e9-4a3a-9838-2576cd138757 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:37.131770 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-87f28780-b6e9-4a3a-9838-2576cd138757 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:37.132195 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-87f28780-b6e9-4a3a-9838-2576cd138757 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:37.161987 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.objects.instance [None req-87f28780-b6e9-4a3a-9838-2576cd138757 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lazy-loading 'flavor' on Instance uuid 16b81832-5021-4cd2-8ebf-767daeb17673 {{(pid=123566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:02:37.184340 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-2c561cff-89c0-48c3-9e70-812c394741df tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:37.192128 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-2c561cff-89c0-48c3-9e70-812c394741df tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1318 microversion: 2.1 time: 0.176026 Feb 04 18:02:37.207364 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 124/259] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:37 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:02:37.500136 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-87f28780-b6e9-4a3a-9838-2576cd138757 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "POST /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/action" status: 200 len: 32 microversion: 2.1 time: 0.381270 Feb 04 18:02:37.502480 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 136/260] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Feb 4 18:02:37 2022] POST /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/action => generated 32 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 04 18:02:37.510101 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-eee76b3b-3f16-4ba9-bf6d-6359fa53c2c0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:37.510913 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-eee76b3b-3f16-4ba9-bf6d-6359fa53c2c0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:37.518678 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-eee76b3b-3f16-4ba9-bf6d-6359fa53c2c0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:37.519382 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-eee76b3b-3f16-4ba9-bf6d-6359fa53c2c0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:37.520175 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-eee76b3b-3f16-4ba9-bf6d-6359fa53c2c0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:37.520615 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-eee76b3b-3f16-4ba9-bf6d-6359fa53c2c0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:37.719616 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-eee76b3b-3f16-4ba9-bf6d-6359fa53c2c0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:37.730247 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-eee76b3b-3f16-4ba9-bf6d-6359fa53c2c0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.223798 Feb 04 18:02:37.742055 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 125/261] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:37 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:37.756116 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-8db1a194-a5d0-4365-a28f-025ce46a106d req-5bea2fa6-6c1c-4d1b-80dc-fb05554216a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11825ca5-07bd-404f-8133-569adcfb9de0", "name": "network-vif-plugged", "status": "completed", "tag": "d402aa33-a7fe-42e3-b2c8-eb33d0501272"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:02:37.758093 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:02:37.758093 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:02:37.767328 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-8db1a194-a5d0-4365-a28f-025ce46a106d req-5bea2fa6-6c1c-4d1b-80dc-fb05554216a0 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:37.768047 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-8db1a194-a5d0-4365-a28f-025ce46a106d req-5bea2fa6-6c1c-4d1b-80dc-fb05554216a0 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:37.779636 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-8db1a194-a5d0-4365-a28f-025ce46a106d req-5bea2fa6-6c1c-4d1b-80dc-fb05554216a0 service nova] Creating event network-vif-plugged:d402aa33-a7fe-42e3-b2c8-eb33d0501272 for instance 11825ca5-07bd-404f-8133-569adcfb9de0 on hv-cinder-82276 Feb 04 18:02:37.785062 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-8db1a194-a5d0-4365-a28f-025ce46a106d req-5bea2fa6-6c1c-4d1b-80dc-fb05554216a0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033197 Feb 04 18:02:37.786216 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 137/262] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:02:38.080111 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-fd9ca4a0-8912-41c3-b37d-7de536faea36 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:38.080849 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-fd9ca4a0-8912-41c3-b37d-7de536faea36 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:38.087295 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fd9ca4a0-8912-41c3-b37d-7de536faea36 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:38.088014 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fd9ca4a0-8912-41c3-b37d-7de536faea36 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:38.089044 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fd9ca4a0-8912-41c3-b37d-7de536faea36 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:38.089654 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fd9ca4a0-8912-41c3-b37d-7de536faea36 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:38.209794 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-508fbde6-84fe-45d4-812d-325d6d2a6b28 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:38.210509 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-508fbde6-84fe-45d4-812d-325d6d2a6b28 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:38.220918 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-508fbde6-84fe-45d4-812d-325d6d2a6b28 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:38.223262 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-508fbde6-84fe-45d4-812d-325d6d2a6b28 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:38.223262 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-508fbde6-84fe-45d4-812d-325d6d2a6b28 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:38.223262 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-508fbde6-84fe-45d4-812d-325d6d2a6b28 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:38.462745 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-fd9ca4a0-8912-41c3-b37d-7de536faea36 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:38.472100 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-fd9ca4a0-8912-41c3-b37d-7de536faea36 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1553 microversion: 2.1 time: 0.396584 Feb 04 18:02:38.476927 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 126/263] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:38 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1553 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:38.584921 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-508fbde6-84fe-45d4-812d-325d6d2a6b28 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:38.593098 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-508fbde6-84fe-45d4-812d-325d6d2a6b28 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1318 microversion: 2.1 time: 0.387620 Feb 04 18:02:38.593679 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 138/264] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:38 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1318 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:02:38.750069 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-11965eaf-a31d-4afd-b443-2a9a58456c14 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:38.750539 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-11965eaf-a31d-4afd-b443-2a9a58456c14 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:38.758471 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-11965eaf-a31d-4afd-b443-2a9a58456c14 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:38.759557 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-11965eaf-a31d-4afd-b443-2a9a58456c14 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:38.760863 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-11965eaf-a31d-4afd-b443-2a9a58456c14 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:38.761460 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-11965eaf-a31d-4afd-b443-2a9a58456c14 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:38.976347 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-11965eaf-a31d-4afd-b443-2a9a58456c14 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:38.984380 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-11965eaf-a31d-4afd-b443-2a9a58456c14 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.239213 Feb 04 18:02:38.989965 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 127/265] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:38 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:39.492884 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-7d4c2dd8-1711-48a5-90ec-f8e2df8edda0 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:39.493494 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-7d4c2dd8-1711-48a5-90ec-f8e2df8edda0 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:39.500280 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7d4c2dd8-1711-48a5-90ec-f8e2df8edda0 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:39.500727 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7d4c2dd8-1711-48a5-90ec-f8e2df8edda0 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:39.501501 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7d4c2dd8-1711-48a5-90ec-f8e2df8edda0 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:39.501931 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7d4c2dd8-1711-48a5-90ec-f8e2df8edda0 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:39.612810 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-4f2c0021-9fa3-414d-a195-93e06bcceace tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:39.613669 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-4f2c0021-9fa3-414d-a195-93e06bcceace tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:39.621082 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4f2c0021-9fa3-414d-a195-93e06bcceace tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:39.621761 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4f2c0021-9fa3-414d-a195-93e06bcceace tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:39.623546 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4f2c0021-9fa3-414d-a195-93e06bcceace tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:39.624135 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4f2c0021-9fa3-414d-a195-93e06bcceace tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:39.651761 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-7d4c2dd8-1711-48a5-90ec-f8e2df8edda0 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:39.660039 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-7d4c2dd8-1711-48a5-90ec-f8e2df8edda0 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1553 microversion: 2.1 time: 0.170731 Feb 04 18:02:39.660631 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 139/266] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:39 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:39.763285 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-4f2c0021-9fa3-414d-a195-93e06bcceace tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:39.771130 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-4f2c0021-9fa3-414d-a195-93e06bcceace tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1318 microversion: 2.1 time: 0.164975 Feb 04 18:02:39.771710 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 128/267] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:39 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:40.001399 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-184d01fd-247f-4fd1-9f06-b74774186ac5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:40.002213 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-184d01fd-247f-4fd1-9f06-b74774186ac5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:40.008620 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-184d01fd-247f-4fd1-9f06-b74774186ac5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:40.009068 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-184d01fd-247f-4fd1-9f06-b74774186ac5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:40.009879 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-184d01fd-247f-4fd1-9f06-b74774186ac5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:40.010310 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-184d01fd-247f-4fd1-9f06-b74774186ac5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:40.155366 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-184d01fd-247f-4fd1-9f06-b74774186ac5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:40.163105 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-184d01fd-247f-4fd1-9f06-b74774186ac5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.165579 Feb 04 18:02:40.164330 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 140/268] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:39 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:40.676847 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-9780a409-805d-4743-ad6e-649ea8d48d7a tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:40.677450 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-9780a409-805d-4743-ad6e-649ea8d48d7a tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:40.683247 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9780a409-805d-4743-ad6e-649ea8d48d7a tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:40.683695 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9780a409-805d-4743-ad6e-649ea8d48d7a tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:40.684468 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9780a409-805d-4743-ad6e-649ea8d48d7a tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:40.684909 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9780a409-805d-4743-ad6e-649ea8d48d7a tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:40.748078 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-9780a409-805d-4743-ad6e-649ea8d48d7a tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:40.762010 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-9780a409-805d-4743-ad6e-649ea8d48d7a tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1511 microversion: 2.1 time: 0.086929 Feb 04 18:02:40.762010 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 129/269] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:40 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1511 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:40.788421 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ff0094a1-38b1-42c4-9b18-5caa57d89aab tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:40.789079 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ff0094a1-38b1-42c4-9b18-5caa57d89aab tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:40.796258 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ff0094a1-38b1-42c4-9b18-5caa57d89aab tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:40.801842 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ff0094a1-38b1-42c4-9b18-5caa57d89aab tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:40.801842 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ff0094a1-38b1-42c4-9b18-5caa57d89aab tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:40.801842 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ff0094a1-38b1-42c4-9b18-5caa57d89aab tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:40.859606 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-b877c042-e94a-4168-b54e-95497ad187f6 req-fe495773-2646-432e-9349-e15301fa93f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac7788c2-1c60-4ef7-ae66-10e8d75a8807", "name": "network-vif-deleted", "tag": "28ad9a9d-773a-41b6-b970-7a330131600a"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:02:40.860623 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:02:40.860623 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:02:40.869671 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-b877c042-e94a-4168-b54e-95497ad187f6 req-fe495773-2646-432e-9349-e15301fa93f1 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:40.870357 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-b877c042-e94a-4168-b54e-95497ad187f6 req-fe495773-2646-432e-9349-e15301fa93f1 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:40.884158 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-b877c042-e94a-4168-b54e-95497ad187f6 req-fe495773-2646-432e-9349-e15301fa93f1 service nova] Creating event network-vif-deleted:28ad9a9d-773a-41b6-b970-7a330131600a for instance ac7788c2-1c60-4ef7-ae66-10e8d75a8807 on hv-cinder-82276 Feb 04 18:02:40.889554 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-b877c042-e94a-4168-b54e-95497ad187f6 req-fe495773-2646-432e-9349-e15301fa93f1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034623 Feb 04 18:02:40.890735 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 130/270] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:02:40.951069 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-ff0094a1-38b1-42c4-9b18-5caa57d89aab tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:40.958994 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ff0094a1-38b1-42c4-9b18-5caa57d89aab tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1318 microversion: 2.1 time: 0.174331 Feb 04 18:02:40.959593 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 141/271] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:40 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:41.181057 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-829aaa57-e9fd-4ff4-b598-2bc0626666a5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:41.182686 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-829aaa57-e9fd-4ff4-b598-2bc0626666a5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:41.189583 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-829aaa57-e9fd-4ff4-b598-2bc0626666a5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:41.190048 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-829aaa57-e9fd-4ff4-b598-2bc0626666a5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:41.190901 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-829aaa57-e9fd-4ff4-b598-2bc0626666a5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:41.191337 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-829aaa57-e9fd-4ff4-b598-2bc0626666a5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:41.343450 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-829aaa57-e9fd-4ff4-b598-2bc0626666a5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:41.350930 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-829aaa57-e9fd-4ff4-b598-2bc0626666a5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.174066 Feb 04 18:02:41.351507 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 131/272] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:41 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:41.777316 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-c5b3a239-712c-48f2-8bc5-6e763fa80cd3 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:41.777915 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-c5b3a239-712c-48f2-8bc5-6e763fa80cd3 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:41.783848 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c5b3a239-712c-48f2-8bc5-6e763fa80cd3 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:41.792686 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c5b3a239-712c-48f2-8bc5-6e763fa80cd3 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:41.792686 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c5b3a239-712c-48f2-8bc5-6e763fa80cd3 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:41.792686 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c5b3a239-712c-48f2-8bc5-6e763fa80cd3 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:41.845461 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c5b3a239-712c-48f2-8bc5-6e763fa80cd3 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:41.853310 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-c5b3a239-712c-48f2-8bc5-6e763fa80cd3 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1346 microversion: 2.1 time: 0.079604 Feb 04 18:02:41.853874 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 142/273] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:41 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1346 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:41.976572 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-d5668c1c-672e-4142-9ef9-1e02739ab8a8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:41.977185 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-d5668c1c-672e-4142-9ef9-1e02739ab8a8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:41.984138 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d5668c1c-672e-4142-9ef9-1e02739ab8a8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:41.984588 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d5668c1c-672e-4142-9ef9-1e02739ab8a8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:41.985371 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d5668c1c-672e-4142-9ef9-1e02739ab8a8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:41.985812 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d5668c1c-672e-4142-9ef9-1e02739ab8a8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:42.132100 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-d5668c1c-672e-4142-9ef9-1e02739ab8a8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:42.145102 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-d5668c1c-672e-4142-9ef9-1e02739ab8a8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1508 microversion: 2.1 time: 0.172140 Feb 04 18:02:42.145699 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 132/274] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:41 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:42.166834 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-1d7107fd-5766-46a7-8c36-959447cf6e96 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8b4480b-dcfc-4a20-a04f-49b4075a99d2"}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:02:42.166834 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-1d7107fd-5766-46a7-8c36-959447cf6e96 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:42.169053 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1d7107fd-5766-46a7-8c36-959447cf6e96 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:42.169590 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1d7107fd-5766-46a7-8c36-959447cf6e96 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:42.170330 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1d7107fd-5766-46a7-8c36-959447cf6e96 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:42.170951 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1d7107fd-5766-46a7-8c36-959447cf6e96 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:42.369116 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-960c9734-9f1d-4214-9039-d75f4098015e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:42.370195 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-960c9734-9f1d-4214-9039-d75f4098015e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:42.377277 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-960c9734-9f1d-4214-9039-d75f4098015e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:42.377726 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-960c9734-9f1d-4214-9039-d75f4098015e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:42.378750 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-960c9734-9f1d-4214-9039-d75f4098015e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:42.379187 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-960c9734-9f1d-4214-9039-d75f4098015e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:42.518887 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-960c9734-9f1d-4214-9039-d75f4098015e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:42.526104 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-960c9734-9f1d-4214-9039-d75f4098015e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.161660 Feb 04 18:02:42.526740 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 133/275] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:42 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:02:42.734599 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-1d7107fd-5766-46a7-8c36-959447cf6e96 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] HTTP exception thrown: Invalid volume: volume a8b4480b-dcfc-4a20-a04f-49b4075a99d2 is already attached to instances: c1d9c781-2198-40c6-a4ec-cd2422de004d Feb 04 18:02:42.735195 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-1d7107fd-5766-46a7-8c36-959447cf6e96 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Returning 400 to user: Invalid volume: volume a8b4480b-dcfc-4a20-a04f-49b4075a99d2 is already attached to instances: c1d9c781-2198-40c6-a4ec-cd2422de004d {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:02:42.736030 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-1d7107fd-5766-46a7-8c36-959447cf6e96 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "POST /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.578228 Feb 04 18:02:42.740455 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 143/276] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Feb 4 18:02:42 2022] POST /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0/os-volume_attachments => generated 174 bytes in 579 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 04 18:02:42.870756 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-4d2ba158-fa3f-4101-8c7e-09555a7ff707 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:42.871355 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-4d2ba158-fa3f-4101-8c7e-09555a7ff707 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:42.877824 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4d2ba158-fa3f-4101-8c7e-09555a7ff707 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:42.878276 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4d2ba158-fa3f-4101-8c7e-09555a7ff707 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:42.879087 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4d2ba158-fa3f-4101-8c7e-09555a7ff707 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:42.879518 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4d2ba158-fa3f-4101-8c7e-09555a7ff707 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:42.909873 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4d2ba158-fa3f-4101-8c7e-09555a7ff707 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:42.910318 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4d2ba158-fa3f-4101-8c7e-09555a7ff707 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:42.911730 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.objects.instance [None req-4d2ba158-fa3f-4101-8c7e-09555a7ff707 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lazy-loading 'fault' on Instance uuid ac7788c2-1c60-4ef7-ae66-10e8d75a8807 {{(pid=123567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:02:42.955159 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-4d2ba158-fa3f-4101-8c7e-09555a7ff707 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7908f45bdeae40b6b31a7b5fd0d1c2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a6093b8812451283ddc89510d3000a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:42.964051 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-4d2ba158-fa3f-4101-8c7e-09555a7ff707 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 200 len: 1351 microversion: 2.1 time: 0.096678 Feb 04 18:02:42.967981 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 134/277] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:42 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 1351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:43.033344 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-65cd3ced-9b59-4141-9e63-a1e0d02db03f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:43.033896 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-65cd3ced-9b59-4141-9e63-a1e0d02db03f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:43.040726 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-65cd3ced-9b59-4141-9e63-a1e0d02db03f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:43.041180 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-65cd3ced-9b59-4141-9e63-a1e0d02db03f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:43.041966 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-65cd3ced-9b59-4141-9e63-a1e0d02db03f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:43.042402 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-65cd3ced-9b59-4141-9e63-a1e0d02db03f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:43.165733 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.objects.instance [None req-65cd3ced-9b59-4141-9e63-a1e0d02db03f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lazy-loading 'services' on Instance uuid c1d9c781-2198-40c6-a4ec-cd2422de004d {{(pid=123566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:02:43.456424 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-65cd3ced-9b59-4141-9e63-a1e0d02db03f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "DELETE /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d/os-volume_attachments/a8b4480b-dcfc-4a20-a04f-49b4075a99d2" status: 202 len: 0 microversion: 2.1 time: 0.427051 Feb 04 18:02:43.457152 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 144/278] 10.222.0.98 () {58 vars in 1415 bytes} [Fri Feb 4 18:02:43 2022] DELETE /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d/os-volume_attachments/a8b4480b-dcfc-4a20-a04f-49b4075a99d2 => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 04 18:02:43.470551 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-93a12a0b-b210-4dbb-a39d-a37da8015e82 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:43.472371 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-93a12a0b-b210-4dbb-a39d-a37da8015e82 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:43.481257 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-93a12a0b-b210-4dbb-a39d-a37da8015e82 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:43.481711 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-93a12a0b-b210-4dbb-a39d-a37da8015e82 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:43.482572 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-93a12a0b-b210-4dbb-a39d-a37da8015e82 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:43.483069 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-93a12a0b-b210-4dbb-a39d-a37da8015e82 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:43.513996 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-93a12a0b-b210-4dbb-a39d-a37da8015e82 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047669 Feb 04 18:02:43.514593 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 135/279] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:02:43 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:02:43.544129 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-64cc46f9-2ff3-4c9d-9803-8baac1ec88d4 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:43.544881 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-64cc46f9-2ff3-4c9d-9803-8baac1ec88d4 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:43.551017 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-64cc46f9-2ff3-4c9d-9803-8baac1ec88d4 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:43.551473 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-64cc46f9-2ff3-4c9d-9803-8baac1ec88d4 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:43.552264 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-64cc46f9-2ff3-4c9d-9803-8baac1ec88d4 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:43.552751 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-64cc46f9-2ff3-4c9d-9803-8baac1ec88d4 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:43.700728 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-64cc46f9-2ff3-4c9d-9803-8baac1ec88d4 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:43.708568 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-64cc46f9-2ff3-4c9d-9803-8baac1ec88d4 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.168547 Feb 04 18:02:43.709145 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 145/280] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:43 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:43.981011 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-2f617dab-71fa-43d8-8a89-274fe04dcf56 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:43.981658 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-2f617dab-71fa-43d8-8a89-274fe04dcf56 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:43.988568 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2f617dab-71fa-43d8-8a89-274fe04dcf56 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:43.989009 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2f617dab-71fa-43d8-8a89-274fe04dcf56 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:43.989909 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2f617dab-71fa-43d8-8a89-274fe04dcf56 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:43.990344 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2f617dab-71fa-43d8-8a89-274fe04dcf56 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:44.005409 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.wsgi [None req-2f617dab-71fa-43d8-8a89-274fe04dcf56 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] HTTP exception thrown: Instance ac7788c2-1c60-4ef7-ae66-10e8d75a8807 could not be found. Feb 04 18:02:44.005997 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-2f617dab-71fa-43d8-8a89-274fe04dcf56 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Returning 404 to user: Instance ac7788c2-1c60-4ef7-ae66-10e8d75a8807 could not be found. {{(pid=123567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:02:44.006925 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-2f617dab-71fa-43d8-8a89-274fe04dcf56 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 404 len: 111 microversion: 2.1 time: 0.029626 Feb 04 18:02:44.007471 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 136/281] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:43 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:02:44.187302 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-88a893a1-cf1e-4c1b-a5b3-3c31a65c9853 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:44.188151 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-88a893a1-cf1e-4c1b-a5b3-3c31a65c9853 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:44.194745 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-88a893a1-cf1e-4c1b-a5b3-3c31a65c9853 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:44.195200 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-88a893a1-cf1e-4c1b-a5b3-3c31a65c9853 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:44.196128 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-88a893a1-cf1e-4c1b-a5b3-3c31a65c9853 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:44.196572 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-88a893a1-cf1e-4c1b-a5b3-3c31a65c9853 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:44.209554 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-88a893a1-cf1e-4c1b-a5b3-3c31a65c9853 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] HTTP exception thrown: Instance ac7788c2-1c60-4ef7-ae66-10e8d75a8807 could not be found. Feb 04 18:02:44.210150 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-88a893a1-cf1e-4c1b-a5b3-3c31a65c9853 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Returning 404 to user: Instance ac7788c2-1c60-4ef7-ae66-10e8d75a8807 could not be found. {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:02:44.211044 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-88a893a1-cf1e-4c1b-a5b3-3c31a65c9853 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028406 Feb 04 18:02:44.211593 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 146/282] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:02:44 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807/os-volume_attachments => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:02:44.525189 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b6daea6d-57e1-4c69-b5b8-f8c1fa5611fc tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:44.526133 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-b6daea6d-57e1-4c69-b5b8-f8c1fa5611fc tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:44.535292 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b6daea6d-57e1-4c69-b5b8-f8c1fa5611fc tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:44.535750 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b6daea6d-57e1-4c69-b5b8-f8c1fa5611fc tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:44.536540 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b6daea6d-57e1-4c69-b5b8-f8c1fa5611fc tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:44.536985 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b6daea6d-57e1-4c69-b5b8-f8c1fa5611fc tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:44.566881 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b6daea6d-57e1-4c69-b5b8-f8c1fa5611fc tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045368 Feb 04 18:02:44.567463 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 137/283] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:02:44 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:02:44.724936 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-4a21d3aa-7a08-4f31-9f58-036ceec77db5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:44.725554 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-4a21d3aa-7a08-4f31-9f58-036ceec77db5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:44.731783 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4a21d3aa-7a08-4f31-9f58-036ceec77db5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:44.732243 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4a21d3aa-7a08-4f31-9f58-036ceec77db5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:44.733042 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4a21d3aa-7a08-4f31-9f58-036ceec77db5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:44.733664 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4a21d3aa-7a08-4f31-9f58-036ceec77db5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:44.871054 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-4a21d3aa-7a08-4f31-9f58-036ceec77db5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:44.878672 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-4a21d3aa-7a08-4f31-9f58-036ceec77db5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.157451 Feb 04 18:02:44.879287 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 147/284] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:44 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:45.578736 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c9e6b329-fd0e-4af7-a663-0858eac5ed08 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:45.579676 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c9e6b329-fd0e-4af7-a663-0858eac5ed08 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:45.585859 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c9e6b329-fd0e-4af7-a663-0858eac5ed08 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:45.586309 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c9e6b329-fd0e-4af7-a663-0858eac5ed08 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:45.587122 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c9e6b329-fd0e-4af7-a663-0858eac5ed08 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:45.587562 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c9e6b329-fd0e-4af7-a663-0858eac5ed08 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:45.616283 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c9e6b329-fd0e-4af7-a663-0858eac5ed08 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041827 Feb 04 18:02:45.616842 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 138/285] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:02:45 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:02:45.896005 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-424965b4-3dbb-46bc-84df-d926e7df91f6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:45.896606 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-424965b4-3dbb-46bc-84df-d926e7df91f6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:45.902941 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-424965b4-3dbb-46bc-84df-d926e7df91f6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:45.903385 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-424965b4-3dbb-46bc-84df-d926e7df91f6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:45.904150 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-424965b4-3dbb-46bc-84df-d926e7df91f6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:45.904710 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-424965b4-3dbb-46bc-84df-d926e7df91f6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:46.035624 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-424965b4-3dbb-46bc-84df-d926e7df91f6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:46.042917 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-424965b4-3dbb-46bc-84df-d926e7df91f6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.150490 Feb 04 18:02:46.043486 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 148/286] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:45 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:46.627811 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-8a4a2026-c6f9-47f1-a499-8368bbccf284 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:46.628643 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-8a4a2026-c6f9-47f1-a499-8368bbccf284 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:46.634846 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8a4a2026-c6f9-47f1-a499-8368bbccf284 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:46.635328 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8a4a2026-c6f9-47f1-a499-8368bbccf284 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:46.636104 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8a4a2026-c6f9-47f1-a499-8368bbccf284 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:46.636539 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8a4a2026-c6f9-47f1-a499-8368bbccf284 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:46.665191 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-8a4a2026-c6f9-47f1-a499-8368bbccf284 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041216 Feb 04 18:02:46.665749 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 139/287] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:02:46 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:02:47.059827 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-5f2e8434-6d6b-4b95-a372-9a3ef4895142 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:47.060472 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-5f2e8434-6d6b-4b95-a372-9a3ef4895142 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:47.066836 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5f2e8434-6d6b-4b95-a372-9a3ef4895142 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:47.067288 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5f2e8434-6d6b-4b95-a372-9a3ef4895142 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:47.068060 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5f2e8434-6d6b-4b95-a372-9a3ef4895142 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:47.068499 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5f2e8434-6d6b-4b95-a372-9a3ef4895142 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:47.214537 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-5f2e8434-6d6b-4b95-a372-9a3ef4895142 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:47.219664 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-5f2e8434-6d6b-4b95-a372-9a3ef4895142 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.163434 Feb 04 18:02:47.220227 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 149/288] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:47 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:47.676531 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-648588d0-2e1f-468c-9965-0bef23a8d2d3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:47.677373 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-648588d0-2e1f-468c-9965-0bef23a8d2d3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:47.683650 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-648588d0-2e1f-468c-9965-0bef23a8d2d3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:47.684207 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-648588d0-2e1f-468c-9965-0bef23a8d2d3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:47.684875 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-648588d0-2e1f-468c-9965-0bef23a8d2d3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:47.685989 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-648588d0-2e1f-468c-9965-0bef23a8d2d3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:47.714670 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-648588d0-2e1f-468c-9965-0bef23a8d2d3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041873 Feb 04 18:02:47.715238 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 140/289] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:02:47 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:02:48.236986 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-29989666-886b-4407-af9f-38f618ce7414 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:48.238018 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-29989666-886b-4407-af9f-38f618ce7414 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:48.244565 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-29989666-886b-4407-af9f-38f618ce7414 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:48.245019 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-29989666-886b-4407-af9f-38f618ce7414 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:48.245830 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-29989666-886b-4407-af9f-38f618ce7414 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:48.246269 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-29989666-886b-4407-af9f-38f618ce7414 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:48.410355 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-29989666-886b-4407-af9f-38f618ce7414 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:48.418721 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-29989666-886b-4407-af9f-38f618ce7414 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.185772 Feb 04 18:02:48.419592 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 150/290] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:48 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:48.725647 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-ffd20733-eefd-411e-850b-6c974647a033 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:48.726607 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-ffd20733-eefd-411e-850b-6c974647a033 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:48.733051 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ffd20733-eefd-411e-850b-6c974647a033 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:48.733505 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ffd20733-eefd-411e-850b-6c974647a033 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:48.734364 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ffd20733-eefd-411e-850b-6c974647a033 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:48.734763 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ffd20733-eefd-411e-850b-6c974647a033 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:48.765752 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-ffd20733-eefd-411e-850b-6c974647a033 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043743 Feb 04 18:02:48.766335 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 141/291] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:02:48 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:02:49.437230 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-e4e4b43a-19a2-48a8-8428-ace9c12c243e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:49.437837 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-e4e4b43a-19a2-48a8-8428-ace9c12c243e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:49.444175 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e4e4b43a-19a2-48a8-8428-ace9c12c243e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:49.444623 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e4e4b43a-19a2-48a8-8428-ace9c12c243e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:49.445398 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e4e4b43a-19a2-48a8-8428-ace9c12c243e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:49.445832 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e4e4b43a-19a2-48a8-8428-ace9c12c243e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:49.586914 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-e4e4b43a-19a2-48a8-8428-ace9c12c243e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:49.594230 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-e4e4b43a-19a2-48a8-8428-ace9c12c243e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.161102 Feb 04 18:02:49.594824 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 151/292] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:49 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:49.777101 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-5f620181-31f5-47b1-ba4c-1f42f06b4591 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:49.778004 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-5f620181-31f5-47b1-ba4c-1f42f06b4591 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:49.784083 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5f620181-31f5-47b1-ba4c-1f42f06b4591 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:49.784528 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5f620181-31f5-47b1-ba4c-1f42f06b4591 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:49.785304 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5f620181-31f5-47b1-ba4c-1f42f06b4591 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:49.785748 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5f620181-31f5-47b1-ba4c-1f42f06b4591 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:49.815640 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-5f620181-31f5-47b1-ba4c-1f42f06b4591 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042253 Feb 04 18:02:49.816208 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 142/293] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:02:49 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:02:50.111571 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ac59b9b5-5770-4f0a-9975-90008fa33f43 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:50.112314 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ac59b9b5-5770-4f0a-9975-90008fa33f43 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:50.119596 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ac59b9b5-5770-4f0a-9975-90008fa33f43 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:50.120041 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ac59b9b5-5770-4f0a-9975-90008fa33f43 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:50.120822 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ac59b9b5-5770-4f0a-9975-90008fa33f43 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:50.121265 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ac59b9b5-5770-4f0a-9975-90008fa33f43 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:50.136088 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-ac59b9b5-5770-4f0a-9975-90008fa33f43 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] HTTP exception thrown: Instance ac7788c2-1c60-4ef7-ae66-10e8d75a8807 could not be found. Feb 04 18:02:50.136754 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ac59b9b5-5770-4f0a-9975-90008fa33f43 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Returning 404 to user: Instance ac7788c2-1c60-4ef7-ae66-10e8d75a8807 could not be found. {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:02:50.137640 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ac59b9b5-5770-4f0a-9975-90008fa33f43 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "DELETE /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 404 len: 111 microversion: 2.1 time: 0.030256 Feb 04 18:02:50.138601 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 152/294] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Feb 4 18:02:50 2022] DELETE /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:02:50.155142 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3497295c-f716-4e97-8888-0e134fcffbf2 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:50.155142 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-3497295c-f716-4e97-8888-0e134fcffbf2 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] [instance: ac7788c2-1c60-4ef7-ae66-10e8d75a8807] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:50.160582 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3497295c-f716-4e97-8888-0e134fcffbf2 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:50.161030 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3497295c-f716-4e97-8888-0e134fcffbf2 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:50.161892 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3497295c-f716-4e97-8888-0e134fcffbf2 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:50.162330 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3497295c-f716-4e97-8888-0e134fcffbf2 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:50.176831 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.wsgi [None req-3497295c-f716-4e97-8888-0e134fcffbf2 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] HTTP exception thrown: Instance ac7788c2-1c60-4ef7-ae66-10e8d75a8807 could not be found. Feb 04 18:02:50.177428 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3497295c-f716-4e97-8888-0e134fcffbf2 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] Returning 404 to user: Instance ac7788c2-1c60-4ef7-ae66-10e8d75a8807 could not be found. {{(pid=123567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:02:50.178651 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-3497295c-f716-4e97-8888-0e134fcffbf2 tempest-DeleteServersTestJSON-1222571029 tempest-DeleteServersTestJSON-1222571029-project] 10.222.0.98 "GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807" status: 404 len: 111 microversion: 2.1 time: 0.028197 Feb 04 18:02:50.179211 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 143/295] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:50 2022] GET /compute/v2.1/servers/ac7788c2-1c60-4ef7-ae66-10e8d75a8807 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:02:50.610092 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-478153ea-842b-4562-977b-18cc959c541b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:50.610756 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-478153ea-842b-4562-977b-18cc959c541b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:50.617460 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-478153ea-842b-4562-977b-18cc959c541b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:50.617871 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-478153ea-842b-4562-977b-18cc959c541b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:50.618690 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-478153ea-842b-4562-977b-18cc959c541b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:50.619168 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-478153ea-842b-4562-977b-18cc959c541b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:50.827440 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-6c4b7b59-1b03-44e6-a1a3-1f304c0044a9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:50.828538 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-6c4b7b59-1b03-44e6-a1a3-1f304c0044a9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:50.831753 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-478153ea-842b-4562-977b-18cc959c541b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:50.836932 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6c4b7b59-1b03-44e6-a1a3-1f304c0044a9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:50.837595 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6c4b7b59-1b03-44e6-a1a3-1f304c0044a9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:50.838690 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6c4b7b59-1b03-44e6-a1a3-1f304c0044a9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:50.839137 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6c4b7b59-1b03-44e6-a1a3-1f304c0044a9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:50.839673 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-478153ea-842b-4562-977b-18cc959c541b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.233273 Feb 04 18:02:50.840392 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 153/296] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:50 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:50.870262 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-6c4b7b59-1b03-44e6-a1a3-1f304c0044a9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046540 Feb 04 18:02:50.870786 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 144/297] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:02:50 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 04 18:02:51.037624 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-fdd9096b-4f92-420c-ae5c-370a2234a5d8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-280373311", "imageRef": "b0fb57f5-967d-4692-94f3-accee37910c3", "flavorRef": "452", "networks": [{"uuid": "3dc2f191-988b-4e16-974b-c84a0b6125d2"}]}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:02:51.089031 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.network.neutron [None req-fdd9096b-4f92-420c-ae5c-370a2234a5d8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] validate_networks() for [('3dc2f191-988b-4e16-974b-c84a0b6125d2', None, None, None, None, None)] {{(pid=123566) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 04 18:02:51.465456 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-fdd9096b-4f92-420c-ae5c-370a2234a5d8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Flavor limits 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 04 18:02:51.466107 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-fdd9096b-4f92-420c-ae5c-370a2234a5d8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Image limits 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 04 18:02:51.467426 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-fdd9096b-4f92-420c-ae5c-370a2234a5d8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Flavor pref 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 04 18:02:51.467925 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-fdd9096b-4f92-420c-ae5c-370a2234a5d8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Image pref 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 04 18:02:51.468401 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-fdd9096b-4f92-420c-ae5c-370a2234a5d8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 04 18:02:51.477559 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fdd9096b-4f92-420c-ae5c-370a2234a5d8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:51.478270 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fdd9096b-4f92-420c-ae5c-370a2234a5d8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:51.479311 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fdd9096b-4f92-420c-ae5c-370a2234a5d8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:51.479999 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fdd9096b-4f92-420c-ae5c-370a2234a5d8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:51.499445 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-fdd9096b-4f92-420c-ae5c-370a2234a5d8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Getting quotas for project c4a8ffd2aaf14a21a0545cb345ab262f. Resources: {'cores', 'ram', 'instances'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:02:51.504770 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-fdd9096b-4f92-420c-ae5c-370a2234a5d8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Getting quotas for user e9bd306bfd5f4867b300ada22547897f and project c4a8ffd2aaf14a21a0545cb345ab262f. Resources: {'cores', 'ram', 'instances'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:02:51.517340 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-fdd9096b-4f92-420c-ae5c-370a2234a5d8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Going to run 1 instances... {{(pid=123566) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 04 18:02:51.519705 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-fdd9096b-4f92-420c-ae5c-370a2234a5d8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0fb57f5-967d-4692-94f3-accee37910c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 04 18:02:51.676556 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-fdd9096b-4f92-420c-ae5c-370a2234a5d8 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642779 Feb 04 18:02:51.677330 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 154/298] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Feb 4 18:02:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 04 18:02:51.688511 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-357ef96d-bf58-4475-8f74-8beba61d389a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:51.689450 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-357ef96d-bf58-4475-8f74-8beba61d389a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:51.752433 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-357ef96d-bf58-4475-8f74-8beba61d389a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:51.759246 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-357ef96d-bf58-4475-8f74-8beba61d389a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1217 microversion: 2.1 time: 0.075788 Feb 04 18:02:51.759860 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 145/299] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:51 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:51.856959 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-6573d66b-c964-45f6-b246-6fbbc2be2225 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:51.861851 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-6573d66b-c964-45f6-b246-6fbbc2be2225 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:51.865157 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6573d66b-c964-45f6-b246-6fbbc2be2225 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:51.865613 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6573d66b-c964-45f6-b246-6fbbc2be2225 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:51.866404 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6573d66b-c964-45f6-b246-6fbbc2be2225 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:51.866877 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6573d66b-c964-45f6-b246-6fbbc2be2225 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:52.016920 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-6573d66b-c964-45f6-b246-6fbbc2be2225 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:52.025289 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-6573d66b-c964-45f6-b246-6fbbc2be2225 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.172465 Feb 04 18:02:52.025873 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 155/300] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:51 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:52.780796 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-ccb3e4f8-bf00-41f2-87fd-3550cfe1d11e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:52.781412 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-ccb3e4f8-bf00-41f2-87fd-3550cfe1d11e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:52.787765 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ccb3e4f8-bf00-41f2-87fd-3550cfe1d11e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:52.788328 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ccb3e4f8-bf00-41f2-87fd-3550cfe1d11e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:52.789209 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ccb3e4f8-bf00-41f2-87fd-3550cfe1d11e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:52.789655 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ccb3e4f8-bf00-41f2-87fd-3550cfe1d11e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:52.855523 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ccb3e4f8-bf00-41f2-87fd-3550cfe1d11e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:52.863396 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-ccb3e4f8-bf00-41f2-87fd-3550cfe1d11e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1221 microversion: 2.1 time: 0.090628 Feb 04 18:02:52.864244 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 146/301] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:52 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1221 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:02:53.042893 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ef94e4a8-5d32-444f-86d5-9dc96c79f76c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:53.043503 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ef94e4a8-5d32-444f-86d5-9dc96c79f76c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:53.050924 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ef94e4a8-5d32-444f-86d5-9dc96c79f76c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:53.051378 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ef94e4a8-5d32-444f-86d5-9dc96c79f76c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:53.052173 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ef94e4a8-5d32-444f-86d5-9dc96c79f76c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:53.052629 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ef94e4a8-5d32-444f-86d5-9dc96c79f76c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:53.224668 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-ef94e4a8-5d32-444f-86d5-9dc96c79f76c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:53.231369 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ef94e4a8-5d32-444f-86d5-9dc96c79f76c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.192044 Feb 04 18:02:53.232046 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 156/302] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:53 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:53.879814 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-87d0cfbe-d2b7-4797-9939-59cb9b6249cd tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:53.880464 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-87d0cfbe-d2b7-4797-9939-59cb9b6249cd tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:53.886928 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-87d0cfbe-d2b7-4797-9939-59cb9b6249cd tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:53.887385 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-87d0cfbe-d2b7-4797-9939-59cb9b6249cd tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:53.888280 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-87d0cfbe-d2b7-4797-9939-59cb9b6249cd tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:53.888721 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-87d0cfbe-d2b7-4797-9939-59cb9b6249cd tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:53.952435 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-87d0cfbe-d2b7-4797-9939-59cb9b6249cd tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:53.959701 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-87d0cfbe-d2b7-4797-9939-59cb9b6249cd tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1221 microversion: 2.1 time: 0.083653 Feb 04 18:02:53.960274 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 147/303] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:53 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:54.247538 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-124610d4-116a-42ed-833d-5b22293688c3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:54.248481 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-124610d4-116a-42ed-833d-5b22293688c3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:54.254873 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-124610d4-116a-42ed-833d-5b22293688c3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:54.255410 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-124610d4-116a-42ed-833d-5b22293688c3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:54.256214 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-124610d4-116a-42ed-833d-5b22293688c3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:54.256653 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-124610d4-116a-42ed-833d-5b22293688c3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:54.409039 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-124610d4-116a-42ed-833d-5b22293688c3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:54.417751 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-124610d4-116a-42ed-833d-5b22293688c3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.173786 Feb 04 18:02:54.418333 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 157/304] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:54 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:54.976751 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-11b019d1-f621-4d7b-b8ad-abcaf14ad3fa tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:54.977518 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-11b019d1-f621-4d7b-b8ad-abcaf14ad3fa tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:54.988948 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-11b019d1-f621-4d7b-b8ad-abcaf14ad3fa tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:54.988948 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-11b019d1-f621-4d7b-b8ad-abcaf14ad3fa tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:54.988948 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-11b019d1-f621-4d7b-b8ad-abcaf14ad3fa tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:54.989203 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-11b019d1-f621-4d7b-b8ad-abcaf14ad3fa tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:55.054402 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-11b019d1-f621-4d7b-b8ad-abcaf14ad3fa tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:55.061706 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-11b019d1-f621-4d7b-b8ad-abcaf14ad3fa tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1221 microversion: 2.1 time: 0.088894 Feb 04 18:02:55.062300 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 148/305] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:54 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1221 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:55.434908 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-22d81dff-79c3-4d40-a75e-61e68b170f6d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:55.436079 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-22d81dff-79c3-4d40-a75e-61e68b170f6d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:55.442910 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-22d81dff-79c3-4d40-a75e-61e68b170f6d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:55.443425 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-22d81dff-79c3-4d40-a75e-61e68b170f6d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:55.444229 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-22d81dff-79c3-4d40-a75e-61e68b170f6d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:55.444668 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-22d81dff-79c3-4d40-a75e-61e68b170f6d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:55.582729 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-22d81dff-79c3-4d40-a75e-61e68b170f6d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:55.590654 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-22d81dff-79c3-4d40-a75e-61e68b170f6d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.159214 Feb 04 18:02:55.591357 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 158/306] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:55 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:56.078307 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-21faae50-4055-4b42-b232-409f15b20eaf tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:56.078943 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-21faae50-4055-4b42-b232-409f15b20eaf tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:56.086109 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-21faae50-4055-4b42-b232-409f15b20eaf tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:56.086590 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-21faae50-4055-4b42-b232-409f15b20eaf tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:56.088243 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-21faae50-4055-4b42-b232-409f15b20eaf tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:56.088754 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-21faae50-4055-4b42-b232-409f15b20eaf tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:56.157335 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-21faae50-4055-4b42-b232-409f15b20eaf tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:56.165277 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-21faae50-4055-4b42-b232-409f15b20eaf tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1277 microversion: 2.1 time: 0.090948 Feb 04 18:02:56.176310 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 149/307] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:56 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1277 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:56.609945 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ae2001f0-9cfd-4125-86e9-29448add4b71 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:56.610915 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ae2001f0-9cfd-4125-86e9-29448add4b71 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:56.627593 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ae2001f0-9cfd-4125-86e9-29448add4b71 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:56.629424 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ae2001f0-9cfd-4125-86e9-29448add4b71 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:56.632081 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ae2001f0-9cfd-4125-86e9-29448add4b71 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:56.632536 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ae2001f0-9cfd-4125-86e9-29448add4b71 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:56.812058 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-ae2001f0-9cfd-4125-86e9-29448add4b71 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:56.822062 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ae2001f0-9cfd-4125-86e9-29448add4b71 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.217402 Feb 04 18:02:56.823090 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 159/308] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:56 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:57.188366 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-f3f0cdd3-d72b-431d-8b67-8e26886a33bd tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:57.189138 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-f3f0cdd3-d72b-431d-8b67-8e26886a33bd tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:57.196186 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f3f0cdd3-d72b-431d-8b67-8e26886a33bd tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:57.196493 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f3f0cdd3-d72b-431d-8b67-8e26886a33bd tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:57.197283 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f3f0cdd3-d72b-431d-8b67-8e26886a33bd tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:57.197728 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f3f0cdd3-d72b-431d-8b67-8e26886a33bd tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:57.343822 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-f3f0cdd3-d72b-431d-8b67-8e26886a33bd tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:57.354008 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-f3f0cdd3-d72b-431d-8b67-8e26886a33bd tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1317 microversion: 2.1 time: 0.168707 Feb 04 18:02:57.354809 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 150/309] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:57 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:02:57.840216 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-5fc92f55-ab20-4427-8dee-34cf50ae9359 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:57.841013 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-5fc92f55-ab20-4427-8dee-34cf50ae9359 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:57.854410 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5fc92f55-ab20-4427-8dee-34cf50ae9359 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:57.854882 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5fc92f55-ab20-4427-8dee-34cf50ae9359 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:57.855663 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5fc92f55-ab20-4427-8dee-34cf50ae9359 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:57.856100 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5fc92f55-ab20-4427-8dee-34cf50ae9359 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:58.007323 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-5fc92f55-ab20-4427-8dee-34cf50ae9359 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:58.015826 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-5fc92f55-ab20-4427-8dee-34cf50ae9359 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.179195 Feb 04 18:02:58.016548 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 160/310] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:57 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:58.251535 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-5f58c716-2d8f-4b9e-b2dd-8fe31e0740e6 req-22eafb37-e0c8-4523-81b8-943cac094860 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25f4875c-4f92-4b9e-8a76-8d80a51f293c", "tag": "aa90b4eb-cda8-4006-b093-bbfc35e3c0c7"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:02:58.253509 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:02:58.253509 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:02:58.263845 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-5f58c716-2d8f-4b9e-b2dd-8fe31e0740e6 req-22eafb37-e0c8-4523-81b8-943cac094860 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:58.264432 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-5f58c716-2d8f-4b9e-b2dd-8fe31e0740e6 req-22eafb37-e0c8-4523-81b8-943cac094860 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:58.275718 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-5f58c716-2d8f-4b9e-b2dd-8fe31e0740e6 req-22eafb37-e0c8-4523-81b8-943cac094860 service nova] Creating event network-changed:aa90b4eb-cda8-4006-b093-bbfc35e3c0c7 for instance 25f4875c-4f92-4b9e-8a76-8d80a51f293c on hv-cinder-82276 Feb 04 18:02:58.280744 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-5f58c716-2d8f-4b9e-b2dd-8fe31e0740e6 req-22eafb37-e0c8-4523-81b8-943cac094860 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035129 Feb 04 18:02:58.281377 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 151/311] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:02:58.379857 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-cccf97e9-5038-4f4f-8a9a-bc3f26d59148 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:58.380651 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-cccf97e9-5038-4f4f-8a9a-bc3f26d59148 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:58.386802 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cccf97e9-5038-4f4f-8a9a-bc3f26d59148 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:58.387246 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cccf97e9-5038-4f4f-8a9a-bc3f26d59148 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:58.388044 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cccf97e9-5038-4f4f-8a9a-bc3f26d59148 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:58.388480 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cccf97e9-5038-4f4f-8a9a-bc3f26d59148 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:58.577076 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-cccf97e9-5038-4f4f-8a9a-bc3f26d59148 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:58.588096 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-cccf97e9-5038-4f4f-8a9a-bc3f26d59148 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1317 microversion: 2.1 time: 0.211763 Feb 04 18:02:58.599763 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 161/312] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:58 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:59.033722 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-20bdeaa1-d8cc-475c-a53d-79d15fd03556 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:59.034574 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-20bdeaa1-d8cc-475c-a53d-79d15fd03556 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:59.043848 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-20bdeaa1-d8cc-475c-a53d-79d15fd03556 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:59.044574 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-20bdeaa1-d8cc-475c-a53d-79d15fd03556 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:59.045359 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-20bdeaa1-d8cc-475c-a53d-79d15fd03556 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:59.045886 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-20bdeaa1-d8cc-475c-a53d-79d15fd03556 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:59.181890 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-20bdeaa1-d8cc-475c-a53d-79d15fd03556 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:59.190048 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-20bdeaa1-d8cc-475c-a53d-79d15fd03556 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.160759 Feb 04 18:02:59.190591 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 152/313] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:59 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:02:59.608487 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-93e0e2a9-a4d4-46ec-8422-8919611b5664 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:02:59.612200 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-93e0e2a9-a4d4-46ec-8422-8919611b5664 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:02:59.615878 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-93e0e2a9-a4d4-46ec-8422-8919611b5664 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:59.616394 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-93e0e2a9-a4d4-46ec-8422-8919611b5664 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:59.617405 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-93e0e2a9-a4d4-46ec-8422-8919611b5664 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:02:59.618366 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-93e0e2a9-a4d4-46ec-8422-8919611b5664 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:02:59.756720 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-93e0e2a9-a4d4-46ec-8422-8919611b5664 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:02:59.764615 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-93e0e2a9-a4d4-46ec-8422-8919611b5664 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1317 microversion: 2.1 time: 0.160241 Feb 04 18:02:59.765182 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 162/314] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:02:59 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:03:00.207676 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-cf53c907-9815-49b9-bb52-34aaa65d7351 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:00.208277 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-cf53c907-9815-49b9-bb52-34aaa65d7351 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:00.216822 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cf53c907-9815-49b9-bb52-34aaa65d7351 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:00.216985 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cf53c907-9815-49b9-bb52-34aaa65d7351 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:00.218321 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cf53c907-9815-49b9-bb52-34aaa65d7351 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:00.218695 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cf53c907-9815-49b9-bb52-34aaa65d7351 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:00.364027 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-cf53c907-9815-49b9-bb52-34aaa65d7351 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:00.371426 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-cf53c907-9815-49b9-bb52-34aaa65d7351 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.167470 Feb 04 18:03:00.372002 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 153/315] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:00 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:00.782012 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-202f71d1-a710-41a4-857b-3ac3f027f6e7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:00.782657 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-202f71d1-a710-41a4-857b-3ac3f027f6e7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:00.789053 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-202f71d1-a710-41a4-857b-3ac3f027f6e7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:00.789584 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-202f71d1-a710-41a4-857b-3ac3f027f6e7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:00.790378 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-202f71d1-a710-41a4-857b-3ac3f027f6e7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:00.790840 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-202f71d1-a710-41a4-857b-3ac3f027f6e7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:00.973120 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-202f71d1-a710-41a4-857b-3ac3f027f6e7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:00.980586 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-202f71d1-a710-41a4-857b-3ac3f027f6e7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1317 microversion: 2.1 time: 0.203185 Feb 04 18:03:00.981154 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 163/316] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:00 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:01.387186 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a4a6f046-daae-4091-943b-bb0240a55197 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:01.387792 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-a4a6f046-daae-4091-943b-bb0240a55197 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:01.394617 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a4a6f046-daae-4091-943b-bb0240a55197 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:01.395020 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a4a6f046-daae-4091-943b-bb0240a55197 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:01.395841 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a4a6f046-daae-4091-943b-bb0240a55197 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:01.396276 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a4a6f046-daae-4091-943b-bb0240a55197 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:01.542770 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-a4a6f046-daae-4091-943b-bb0240a55197 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:01.550554 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a4a6f046-daae-4091-943b-bb0240a55197 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.166927 Feb 04 18:03:01.551205 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 154/317] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:01 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:01.997423 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-1b6a6440-515a-40d8-a560-e216944de548 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:01.998849 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-1b6a6440-515a-40d8-a560-e216944de548 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:02.005067 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1b6a6440-515a-40d8-a560-e216944de548 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:02.005515 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1b6a6440-515a-40d8-a560-e216944de548 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:02.006407 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1b6a6440-515a-40d8-a560-e216944de548 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:02.006736 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1b6a6440-515a-40d8-a560-e216944de548 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:02.142956 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-1b6a6440-515a-40d8-a560-e216944de548 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:02.150731 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-1b6a6440-515a-40d8-a560-e216944de548 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1317 microversion: 2.1 time: 0.157246 Feb 04 18:03:02.151440 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 164/318] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:01 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:02.567209 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-afc86816-fba7-40e9-87bf-0ee2ee4e9d01 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:02.567806 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-afc86816-fba7-40e9-87bf-0ee2ee4e9d01 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:02.573882 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-afc86816-fba7-40e9-87bf-0ee2ee4e9d01 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:02.574333 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-afc86816-fba7-40e9-87bf-0ee2ee4e9d01 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:02.575131 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-afc86816-fba7-40e9-87bf-0ee2ee4e9d01 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:02.575559 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-afc86816-fba7-40e9-87bf-0ee2ee4e9d01 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:02.709002 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-afc86816-fba7-40e9-87bf-0ee2ee4e9d01 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:02.716420 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-afc86816-fba7-40e9-87bf-0ee2ee4e9d01 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.152779 Feb 04 18:03:02.717001 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 155/319] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:02 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:03.167456 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-4d1f4802-32af-4432-8e5d-7925ae34eb96 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:03.168065 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-4d1f4802-32af-4432-8e5d-7925ae34eb96 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:03.174715 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4d1f4802-32af-4432-8e5d-7925ae34eb96 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:03.175168 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4d1f4802-32af-4432-8e5d-7925ae34eb96 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:03.176000 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4d1f4802-32af-4432-8e5d-7925ae34eb96 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:03.176442 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4d1f4802-32af-4432-8e5d-7925ae34eb96 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:03.314240 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-4d1f4802-32af-4432-8e5d-7925ae34eb96 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:03.321863 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-4d1f4802-32af-4432-8e5d-7925ae34eb96 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1317 microversion: 2.1 time: 0.158050 Feb 04 18:03:03.322449 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 165/320] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:03 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:03.736843 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-98da10f4-0aea-4798-98b2-d4af10ed1b31 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:03.737459 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-98da10f4-0aea-4798-98b2-d4af10ed1b31 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:03.744203 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-98da10f4-0aea-4798-98b2-d4af10ed1b31 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:03.744650 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-98da10f4-0aea-4798-98b2-d4af10ed1b31 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:03.745441 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-98da10f4-0aea-4798-98b2-d4af10ed1b31 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:03.745908 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-98da10f4-0aea-4798-98b2-d4af10ed1b31 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:03.881693 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-98da10f4-0aea-4798-98b2-d4af10ed1b31 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:03.889113 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-98da10f4-0aea-4798-98b2-d4af10ed1b31 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.156655 Feb 04 18:03:03.889693 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 156/321] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:03 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:04.338647 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-490dc55e-1ae2-4cda-aeb0-aab7c3ad4b04 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:04.339180 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-490dc55e-1ae2-4cda-aeb0-aab7c3ad4b04 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:04.346250 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-490dc55e-1ae2-4cda-aeb0-aab7c3ad4b04 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:04.346739 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-490dc55e-1ae2-4cda-aeb0-aab7c3ad4b04 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:04.347521 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-490dc55e-1ae2-4cda-aeb0-aab7c3ad4b04 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:04.347962 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-490dc55e-1ae2-4cda-aeb0-aab7c3ad4b04 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:04.486522 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-490dc55e-1ae2-4cda-aeb0-aab7c3ad4b04 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:04.494209 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-490dc55e-1ae2-4cda-aeb0-aab7c3ad4b04 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1317 microversion: 2.1 time: 0.159416 Feb 04 18:03:04.494830 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 166/322] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:04 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:04.905788 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-33e2e48e-7bea-4179-bc56-e038ab00358b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:04.906396 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-33e2e48e-7bea-4179-bc56-e038ab00358b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:04.912982 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-33e2e48e-7bea-4179-bc56-e038ab00358b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:04.913431 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-33e2e48e-7bea-4179-bc56-e038ab00358b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:04.914257 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-33e2e48e-7bea-4179-bc56-e038ab00358b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:04.914725 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-33e2e48e-7bea-4179-bc56-e038ab00358b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:05.051342 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-33e2e48e-7bea-4179-bc56-e038ab00358b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:05.059068 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-33e2e48e-7bea-4179-bc56-e038ab00358b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.157117 Feb 04 18:03:05.059731 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 157/323] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:04 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:05.512720 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-737fed9e-4d9d-4c10-a904-9615c889b687 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:05.513394 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-737fed9e-4d9d-4c10-a904-9615c889b687 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:05.519587 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-737fed9e-4d9d-4c10-a904-9615c889b687 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:05.520051 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-737fed9e-4d9d-4c10-a904-9615c889b687 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:05.520834 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-737fed9e-4d9d-4c10-a904-9615c889b687 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:05.521274 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-737fed9e-4d9d-4c10-a904-9615c889b687 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:05.655665 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-737fed9e-4d9d-4c10-a904-9615c889b687 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:05.662839 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-737fed9e-4d9d-4c10-a904-9615c889b687 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1317 microversion: 2.1 time: 0.153726 Feb 04 18:03:05.663413 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 167/324] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:05 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:06.075330 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-ddf84e3d-35ab-457c-acab-eca56c48e465 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:06.075995 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-ddf84e3d-35ab-457c-acab-eca56c48e465 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:06.082943 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ddf84e3d-35ab-457c-acab-eca56c48e465 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:06.083387 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ddf84e3d-35ab-457c-acab-eca56c48e465 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:06.084170 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ddf84e3d-35ab-457c-acab-eca56c48e465 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:06.084605 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ddf84e3d-35ab-457c-acab-eca56c48e465 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:06.242062 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ddf84e3d-35ab-457c-acab-eca56c48e465 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:06.250716 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-ddf84e3d-35ab-457c-acab-eca56c48e465 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.178990 Feb 04 18:03:06.251298 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 158/325] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:06 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:06.681428 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-202f3b3a-29e8-41d1-b15b-9cbc6b418698 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:06.682035 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-202f3b3a-29e8-41d1-b15b-9cbc6b418698 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:06.688903 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-202f3b3a-29e8-41d1-b15b-9cbc6b418698 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:06.689355 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-202f3b3a-29e8-41d1-b15b-9cbc6b418698 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:06.690122 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-202f3b3a-29e8-41d1-b15b-9cbc6b418698 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:06.690606 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-202f3b3a-29e8-41d1-b15b-9cbc6b418698 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:06.831690 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-202f3b3a-29e8-41d1-b15b-9cbc6b418698 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:06.846208 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-202f3b3a-29e8-41d1-b15b-9cbc6b418698 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1317 microversion: 2.1 time: 0.169198 Feb 04 18:03:06.847627 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 168/326] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:06 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:07.272079 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a1b2f5eb-bb39-4ffd-b166-3cf832439778 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:07.272079 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-a1b2f5eb-bb39-4ffd-b166-3cf832439778 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:07.277974 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a1b2f5eb-bb39-4ffd-b166-3cf832439778 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:07.278580 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a1b2f5eb-bb39-4ffd-b166-3cf832439778 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:07.279992 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a1b2f5eb-bb39-4ffd-b166-3cf832439778 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:07.280440 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a1b2f5eb-bb39-4ffd-b166-3cf832439778 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:07.418269 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-a1b2f5eb-bb39-4ffd-b166-3cf832439778 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:07.425674 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a1b2f5eb-bb39-4ffd-b166-3cf832439778 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.162006 Feb 04 18:03:07.426236 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 159/327] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:07 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:07.866224 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-cda04297-3a66-47e8-a50a-ba6c6c1164f2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:07.866799 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-cda04297-3a66-47e8-a50a-ba6c6c1164f2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:07.873152 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cda04297-3a66-47e8-a50a-ba6c6c1164f2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:07.879044 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cda04297-3a66-47e8-a50a-ba6c6c1164f2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:07.879044 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cda04297-3a66-47e8-a50a-ba6c6c1164f2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:07.879044 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cda04297-3a66-47e8-a50a-ba6c6c1164f2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:08.004949 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-cda04297-3a66-47e8-a50a-ba6c6c1164f2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:08.012104 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-cda04297-3a66-47e8-a50a-ba6c6c1164f2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1317 microversion: 2.1 time: 0.150119 Feb 04 18:03:08.012668 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 169/328] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:07 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:08.442446 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-d6c511c6-401b-4c2b-aaf0-84e98d256ff7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:08.442992 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-d6c511c6-401b-4c2b-aaf0-84e98d256ff7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:08.449163 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d6c511c6-401b-4c2b-aaf0-84e98d256ff7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:08.449617 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d6c511c6-401b-4c2b-aaf0-84e98d256ff7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:08.450395 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d6c511c6-401b-4c2b-aaf0-84e98d256ff7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:08.450856 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d6c511c6-401b-4c2b-aaf0-84e98d256ff7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:08.580867 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-d6c511c6-401b-4c2b-aaf0-84e98d256ff7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:08.588236 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-d6c511c6-401b-4c2b-aaf0-84e98d256ff7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.149679 Feb 04 18:03:08.588809 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 160/329] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:08 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:09.029670 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-2004a48a-670d-4588-8040-69942690e6f1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:09.030237 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-2004a48a-670d-4588-8040-69942690e6f1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:09.036438 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2004a48a-670d-4588-8040-69942690e6f1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:09.036879 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2004a48a-670d-4588-8040-69942690e6f1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:09.037640 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2004a48a-670d-4588-8040-69942690e6f1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:09.038073 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2004a48a-670d-4588-8040-69942690e6f1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:09.178673 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2004a48a-670d-4588-8040-69942690e6f1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:09.186031 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-2004a48a-670d-4588-8040-69942690e6f1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1317 microversion: 2.1 time: 0.160542 Feb 04 18:03:09.186633 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 170/330] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:09 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:09.605108 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-0a2df147-1f1f-4a93-b8b0-e30e2be5faa6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:09.605902 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-0a2df147-1f1f-4a93-b8b0-e30e2be5faa6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:09.611990 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0a2df147-1f1f-4a93-b8b0-e30e2be5faa6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:09.612484 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0a2df147-1f1f-4a93-b8b0-e30e2be5faa6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:09.613491 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0a2df147-1f1f-4a93-b8b0-e30e2be5faa6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:09.613931 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0a2df147-1f1f-4a93-b8b0-e30e2be5faa6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:09.754320 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-0a2df147-1f1f-4a93-b8b0-e30e2be5faa6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:09.761704 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-0a2df147-1f1f-4a93-b8b0-e30e2be5faa6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.160460 Feb 04 18:03:09.762272 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 161/331] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:09 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:10.201823 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-e49d9953-a183-40fd-82bf-3014a607adf9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:10.203183 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-e49d9953-a183-40fd-82bf-3014a607adf9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:10.210043 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e49d9953-a183-40fd-82bf-3014a607adf9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:10.210516 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e49d9953-a183-40fd-82bf-3014a607adf9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:10.211304 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e49d9953-a183-40fd-82bf-3014a607adf9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:10.211762 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e49d9953-a183-40fd-82bf-3014a607adf9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:10.555466 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-e49d9953-a183-40fd-82bf-3014a607adf9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:10.563196 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-e49d9953-a183-40fd-82bf-3014a607adf9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1317 microversion: 2.1 time: 0.365169 Feb 04 18:03:10.563774 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 171/332] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:10 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1317 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:10.778823 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-0a465e3b-5248-413f-a233-9a8b42060d89 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:10.779476 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-0a465e3b-5248-413f-a233-9a8b42060d89 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:10.785674 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0a465e3b-5248-413f-a233-9a8b42060d89 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:10.786126 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0a465e3b-5248-413f-a233-9a8b42060d89 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:10.786960 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0a465e3b-5248-413f-a233-9a8b42060d89 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:10.787403 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0a465e3b-5248-413f-a233-9a8b42060d89 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:10.920905 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-0a465e3b-5248-413f-a233-9a8b42060d89 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:10.928167 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-0a465e3b-5248-413f-a233-9a8b42060d89 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.153004 Feb 04 18:03:10.928741 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 162/333] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:10 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:11.578999 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-838f0680-4f3d-4c3e-9c27-579ca9de0f1f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:11.579642 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-838f0680-4f3d-4c3e-9c27-579ca9de0f1f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:11.585888 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-838f0680-4f3d-4c3e-9c27-579ca9de0f1f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:11.586334 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-838f0680-4f3d-4c3e-9c27-579ca9de0f1f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:11.587202 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-838f0680-4f3d-4c3e-9c27-579ca9de0f1f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:11.587637 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-838f0680-4f3d-4c3e-9c27-579ca9de0f1f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:11.721486 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-838f0680-4f3d-4c3e-9c27-579ca9de0f1f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:11.728687 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-838f0680-4f3d-4c3e-9c27-579ca9de0f1f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1317 microversion: 2.1 time: 0.153321 Feb 04 18:03:11.729254 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 172/334] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:11 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:11.944856 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-261a8fc4-3e79-4c26-9531-3e63f99c20f7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:11.945425 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-261a8fc4-3e79-4c26-9531-3e63f99c20f7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:11.952285 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-261a8fc4-3e79-4c26-9531-3e63f99c20f7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:11.952737 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-261a8fc4-3e79-4c26-9531-3e63f99c20f7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:11.953515 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-261a8fc4-3e79-4c26-9531-3e63f99c20f7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:11.953954 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-261a8fc4-3e79-4c26-9531-3e63f99c20f7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:12.081550 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-261a8fc4-3e79-4c26-9531-3e63f99c20f7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:12.088858 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-261a8fc4-3e79-4c26-9531-3e63f99c20f7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.147824 Feb 04 18:03:12.089422 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 163/335] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:11 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:12.746640 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-3d83d248-8a21-4c32-a2a3-97c605bc27a4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:12.748140 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-3d83d248-8a21-4c32-a2a3-97c605bc27a4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:12.759784 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3d83d248-8a21-4c32-a2a3-97c605bc27a4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:12.759784 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3d83d248-8a21-4c32-a2a3-97c605bc27a4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:12.759784 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3d83d248-8a21-4c32-a2a3-97c605bc27a4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:12.759784 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3d83d248-8a21-4c32-a2a3-97c605bc27a4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:12.892614 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-3d83d248-8a21-4c32-a2a3-97c605bc27a4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:12.900007 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-3d83d248-8a21-4c32-a2a3-97c605bc27a4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1317 microversion: 2.1 time: 0.157989 Feb 04 18:03:12.900588 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 173/336] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:12 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:13.104818 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c0b49283-62bb-4efa-8c43-2120819be60c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:13.105350 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c0b49283-62bb-4efa-8c43-2120819be60c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:13.112171 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c0b49283-62bb-4efa-8c43-2120819be60c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:13.112615 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c0b49283-62bb-4efa-8c43-2120819be60c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:13.113633 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c0b49283-62bb-4efa-8c43-2120819be60c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:13.114062 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c0b49283-62bb-4efa-8c43-2120819be60c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:13.252014 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c0b49283-62bb-4efa-8c43-2120819be60c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:13.259308 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c0b49283-62bb-4efa-8c43-2120819be60c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.158179 Feb 04 18:03:13.259891 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 164/337] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:13 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:13.916704 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-6d4e67db-1f5a-470c-b7f4-f45e5c5afd28 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:13.917320 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-6d4e67db-1f5a-470c-b7f4-f45e5c5afd28 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:13.924144 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6d4e67db-1f5a-470c-b7f4-f45e5c5afd28 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:13.928291 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6d4e67db-1f5a-470c-b7f4-f45e5c5afd28 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:13.928291 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6d4e67db-1f5a-470c-b7f4-f45e5c5afd28 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:13.928291 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6d4e67db-1f5a-470c-b7f4-f45e5c5afd28 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:14.058293 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-6d4e67db-1f5a-470c-b7f4-f45e5c5afd28 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:14.065574 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-6d4e67db-1f5a-470c-b7f4-f45e5c5afd28 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1317 microversion: 2.1 time: 0.152554 Feb 04 18:03:14.066133 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 174/338] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:13 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:14.276577 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-575cb6f5-622b-4cd6-86af-efd51fd772c5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:14.277177 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-575cb6f5-622b-4cd6-86af-efd51fd772c5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:14.283381 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-575cb6f5-622b-4cd6-86af-efd51fd772c5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:14.283822 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-575cb6f5-622b-4cd6-86af-efd51fd772c5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:14.284590 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-575cb6f5-622b-4cd6-86af-efd51fd772c5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:14.285022 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-575cb6f5-622b-4cd6-86af-efd51fd772c5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:14.424622 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-575cb6f5-622b-4cd6-86af-efd51fd772c5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:14.431814 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-575cb6f5-622b-4cd6-86af-efd51fd772c5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.158841 Feb 04 18:03:14.432375 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 165/339] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:14 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:15.082358 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-80f4d88c-a0a4-4527-bd32-77540926aff5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:15.083081 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-80f4d88c-a0a4-4527-bd32-77540926aff5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:15.089628 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-80f4d88c-a0a4-4527-bd32-77540926aff5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:15.090147 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-80f4d88c-a0a4-4527-bd32-77540926aff5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:15.090982 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-80f4d88c-a0a4-4527-bd32-77540926aff5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:15.091429 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-80f4d88c-a0a4-4527-bd32-77540926aff5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:15.231208 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-80f4d88c-a0a4-4527-bd32-77540926aff5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:15.240361 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-80f4d88c-a0a4-4527-bd32-77540926aff5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1317 microversion: 2.1 time: 0.161768 Feb 04 18:03:15.241131 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 175/340] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:15 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:15.450524 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-9e490fe2-3598-4bfc-8cbc-fafd99160687 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:15.451813 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-9e490fe2-3598-4bfc-8cbc-fafd99160687 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:15.458591 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9e490fe2-3598-4bfc-8cbc-fafd99160687 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:15.459049 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9e490fe2-3598-4bfc-8cbc-fafd99160687 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:15.459857 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9e490fe2-3598-4bfc-8cbc-fafd99160687 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:15.460291 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9e490fe2-3598-4bfc-8cbc-fafd99160687 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:15.606077 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-9e490fe2-3598-4bfc-8cbc-fafd99160687 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:15.614868 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-9e490fe2-3598-4bfc-8cbc-fafd99160687 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.168415 Feb 04 18:03:15.615465 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 166/341] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:15 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:16.257668 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-d60cf135-2b01-4661-bdc5-d25307899eb0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:16.258280 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-d60cf135-2b01-4661-bdc5-d25307899eb0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:16.264664 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d60cf135-2b01-4661-bdc5-d25307899eb0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:16.265222 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d60cf135-2b01-4661-bdc5-d25307899eb0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:16.266028 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d60cf135-2b01-4661-bdc5-d25307899eb0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:16.266467 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d60cf135-2b01-4661-bdc5-d25307899eb0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:16.412317 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-d60cf135-2b01-4661-bdc5-d25307899eb0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:16.419967 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-d60cf135-2b01-4661-bdc5-d25307899eb0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1317 microversion: 2.1 time: 0.165962 Feb 04 18:03:16.420525 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 176/342] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:16 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:16.633393 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c889cdbd-d428-4abd-ae49-75dc2d24b647 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:16.634178 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c889cdbd-d428-4abd-ae49-75dc2d24b647 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:16.640845 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c889cdbd-d428-4abd-ae49-75dc2d24b647 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:16.641295 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c889cdbd-d428-4abd-ae49-75dc2d24b647 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:16.642177 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c889cdbd-d428-4abd-ae49-75dc2d24b647 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:16.642654 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c889cdbd-d428-4abd-ae49-75dc2d24b647 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:16.868491 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c889cdbd-d428-4abd-ae49-75dc2d24b647 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:16.876591 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c889cdbd-d428-4abd-ae49-75dc2d24b647 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.246976 Feb 04 18:03:16.877201 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 167/343] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:16 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:17.436247 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-2ab2a705-d707-47e2-9048-96225f4ab336 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:17.436941 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-2ab2a705-d707-47e2-9048-96225f4ab336 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:17.443440 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2ab2a705-d707-47e2-9048-96225f4ab336 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:17.443899 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2ab2a705-d707-47e2-9048-96225f4ab336 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:17.444719 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2ab2a705-d707-47e2-9048-96225f4ab336 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:17.445182 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2ab2a705-d707-47e2-9048-96225f4ab336 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:17.585404 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2ab2a705-d707-47e2-9048-96225f4ab336 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:17.593357 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-2ab2a705-d707-47e2-9048-96225f4ab336 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1317 microversion: 2.1 time: 0.160789 Feb 04 18:03:17.593926 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 177/344] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:17 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:17.894078 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-72afb7a7-b338-4ef5-979b-e6f38b17a001 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:17.895671 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-72afb7a7-b338-4ef5-979b-e6f38b17a001 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:17.901951 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-72afb7a7-b338-4ef5-979b-e6f38b17a001 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:17.902408 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-72afb7a7-b338-4ef5-979b-e6f38b17a001 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:17.903249 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-72afb7a7-b338-4ef5-979b-e6f38b17a001 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:17.903794 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-72afb7a7-b338-4ef5-979b-e6f38b17a001 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:18.111656 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-72afb7a7-b338-4ef5-979b-e6f38b17a001 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:18.120189 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-72afb7a7-b338-4ef5-979b-e6f38b17a001 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1502 microversion: 2.1 time: 0.229944 Feb 04 18:03:18.121188 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 168/345] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:17 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1502 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:18.137799 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-857268e5-d6f4-40e7-b175-8eb42ef71659 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "129e9ef5-ffc8-4823-9f7c-7a8e888b541b"}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:03:18.143688 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-857268e5-d6f4-40e7-b175-8eb42ef71659 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:18.145470 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-857268e5-d6f4-40e7-b175-8eb42ef71659 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:18.145929 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-857268e5-d6f4-40e7-b175-8eb42ef71659 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:18.146848 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-857268e5-d6f4-40e7-b175-8eb42ef71659 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:18.147292 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-857268e5-d6f4-40e7-b175-8eb42ef71659 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:18.170298 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-857268e5-d6f4-40e7-b175-8eb42ef71659 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] HTTP exception thrown: Cannot 'attach_volume' instance 16b81832-5021-4cd2-8ebf-767daeb17673 while it is in vm_state rescued Feb 04 18:03:18.170922 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-857268e5-d6f4-40e7-b175-8eb42ef71659 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Returning 409 to user: Cannot 'attach_volume' instance 16b81832-5021-4cd2-8ebf-767daeb17673 while it is in vm_state rescued {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:03:18.171751 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-857268e5-d6f4-40e7-b175-8eb42ef71659 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "POST /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.038148 Feb 04 18:03:18.172301 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 178/346] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Feb 4 18:03:18 2022] POST /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments => generated 152 bytes in 39 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Feb 04 18:03:18.180836 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-8a5524d9-cc2a-4e64-a991-521d4cda073e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:03:18.181381 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-8a5524d9-cc2a-4e64-a991-521d4cda073e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:18.187528 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8a5524d9-cc2a-4e64-a991-521d4cda073e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:18.188203 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8a5524d9-cc2a-4e64-a991-521d4cda073e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:18.189324 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8a5524d9-cc2a-4e64-a991-521d4cda073e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:18.189959 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8a5524d9-cc2a-4e64-a991-521d4cda073e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:18.454641 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-8a5524d9-cc2a-4e64-a991-521d4cda073e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "POST /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/action" status: 202 len: 0 microversion: 2.1 time: 0.277163 Feb 04 18:03:18.455305 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 169/347] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Feb 4 18:03:18 2022] POST /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 04 18:03:18.463205 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-2a916ca6-17e6-457b-9728-51882c8ba133 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:18.463871 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-2a916ca6-17e6-457b-9728-51882c8ba133 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:18.471068 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2a916ca6-17e6-457b-9728-51882c8ba133 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:18.471518 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2a916ca6-17e6-457b-9728-51882c8ba133 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:18.472293 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2a916ca6-17e6-457b-9728-51882c8ba133 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:18.472787 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2a916ca6-17e6-457b-9728-51882c8ba133 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:18.615591 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-6e974807-8c4e-41d2-b51b-ed1ff01fb3d9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:18.616720 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-6e974807-8c4e-41d2-b51b-ed1ff01fb3d9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:18.625454 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6e974807-8c4e-41d2-b51b-ed1ff01fb3d9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:18.626287 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6e974807-8c4e-41d2-b51b-ed1ff01fb3d9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:18.627441 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6e974807-8c4e-41d2-b51b-ed1ff01fb3d9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:18.628138 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6e974807-8c4e-41d2-b51b-ed1ff01fb3d9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:18.644572 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2a916ca6-17e6-457b-9728-51882c8ba133 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:18.654056 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-2a916ca6-17e6-457b-9728-51882c8ba133 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1510 microversion: 2.1 time: 0.194233 Feb 04 18:03:18.654700 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 179/348] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:18 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1510 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:03:18.793412 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-6e974807-8c4e-41d2-b51b-ed1ff01fb3d9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:18.803975 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-6e974807-8c4e-41d2-b51b-ed1ff01fb3d9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1317 microversion: 2.1 time: 0.196681 Feb 04 18:03:18.804574 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 170/349] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:18 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:03:19.445336 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-72ce3bdc-133e-4c95-9069-a9a26662f239 req-60323af2-9a5c-4591-8842-25730ad9ed68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f4875c-4f92-4b9e-8a76-8d80a51f293c", "name": "network-vif-plugged", "status": "completed", "tag": "aa90b4eb-cda8-4006-b093-bbfc35e3c0c7"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:03:19.446893 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:03:19.446893 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:03:19.462797 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-72ce3bdc-133e-4c95-9069-a9a26662f239 req-60323af2-9a5c-4591-8842-25730ad9ed68 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:19.463760 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-72ce3bdc-133e-4c95-9069-a9a26662f239 req-60323af2-9a5c-4591-8842-25730ad9ed68 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:19.477592 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-72ce3bdc-133e-4c95-9069-a9a26662f239 req-60323af2-9a5c-4591-8842-25730ad9ed68 service nova] Creating event network-vif-plugged:aa90b4eb-cda8-4006-b093-bbfc35e3c0c7 for instance 25f4875c-4f92-4b9e-8a76-8d80a51f293c on hv-cinder-82276 Feb 04 18:03:19.484936 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-72ce3bdc-133e-4c95-9069-a9a26662f239 req-60323af2-9a5c-4591-8842-25730ad9ed68 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043091 Feb 04 18:03:19.485548 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 180/350] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:03:19.671366 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b84fb318-8bf4-47bf-a765-15e9c7fd0212 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:19.672252 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-b84fb318-8bf4-47bf-a765-15e9c7fd0212 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:19.678643 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b84fb318-8bf4-47bf-a765-15e9c7fd0212 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:19.679200 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b84fb318-8bf4-47bf-a765-15e9c7fd0212 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:19.680061 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b84fb318-8bf4-47bf-a765-15e9c7fd0212 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:19.680505 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b84fb318-8bf4-47bf-a765-15e9c7fd0212 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:19.829422 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-89fbf44e-c26a-4295-a442-8e72e9e38014 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:19.839245 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-89fbf44e-c26a-4295-a442-8e72e9e38014 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:19.852981 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-89fbf44e-c26a-4295-a442-8e72e9e38014 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:19.854462 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-89fbf44e-c26a-4295-a442-8e72e9e38014 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:19.856137 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-89fbf44e-c26a-4295-a442-8e72e9e38014 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:19.856846 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-89fbf44e-c26a-4295-a442-8e72e9e38014 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:19.881780 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-b84fb318-8bf4-47bf-a765-15e9c7fd0212 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:19.890452 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b84fb318-8bf4-47bf-a765-15e9c7fd0212 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1510 microversion: 2.1 time: 0.222725 Feb 04 18:03:19.891681 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 171/351] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:19 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:20.000824 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-89fbf44e-c26a-4295-a442-8e72e9e38014 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:20.010455 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-89fbf44e-c26a-4295-a442-8e72e9e38014 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1317 microversion: 2.1 time: 0.187652 Feb 04 18:03:20.014625 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 181/352] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:19 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:20.908392 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a356f6fc-2058-4b14-b8bf-660c66839fc6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:20.909536 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-a356f6fc-2058-4b14-b8bf-660c66839fc6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:20.918891 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a356f6fc-2058-4b14-b8bf-660c66839fc6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:20.919879 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a356f6fc-2058-4b14-b8bf-660c66839fc6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:20.920936 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a356f6fc-2058-4b14-b8bf-660c66839fc6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:20.921637 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a356f6fc-2058-4b14-b8bf-660c66839fc6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:21.030393 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-da78cb2a-1df0-4df1-9e52-70d9ed6f0616 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:21.031839 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-da78cb2a-1df0-4df1-9e52-70d9ed6f0616 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:21.039153 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-da78cb2a-1df0-4df1-9e52-70d9ed6f0616 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:21.039911 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-da78cb2a-1df0-4df1-9e52-70d9ed6f0616 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:21.042151 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-da78cb2a-1df0-4df1-9e52-70d9ed6f0616 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:21.042847 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-da78cb2a-1df0-4df1-9e52-70d9ed6f0616 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:21.190639 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-a356f6fc-2058-4b14-b8bf-660c66839fc6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:21.201916 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a356f6fc-2058-4b14-b8bf-660c66839fc6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1510 microversion: 2.1 time: 0.296374 Feb 04 18:03:21.203622 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 172/353] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:20 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1510 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:21.283185 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-da78cb2a-1df0-4df1-9e52-70d9ed6f0616 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:21.295555 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-da78cb2a-1df0-4df1-9e52-70d9ed6f0616 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1317 microversion: 2.1 time: 0.269281 Feb 04 18:03:21.297098 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 182/354] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:21 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:03:22.225091 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-51e0fd38-bd64-46d0-8b78-c441dfe2413b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:22.230960 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-51e0fd38-bd64-46d0-8b78-c441dfe2413b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:22.236382 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-51e0fd38-bd64-46d0-8b78-c441dfe2413b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:22.236834 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-51e0fd38-bd64-46d0-8b78-c441dfe2413b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:22.237636 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-51e0fd38-bd64-46d0-8b78-c441dfe2413b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:22.238071 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-51e0fd38-bd64-46d0-8b78-c441dfe2413b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:22.313396 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-8fdf940c-4492-4e37-8634-998c2b21d7f9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:22.314858 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-8fdf940c-4492-4e37-8634-998c2b21d7f9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:22.321304 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8fdf940c-4492-4e37-8634-998c2b21d7f9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:22.321757 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8fdf940c-4492-4e37-8634-998c2b21d7f9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:22.322594 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8fdf940c-4492-4e37-8634-998c2b21d7f9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:22.323041 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8fdf940c-4492-4e37-8634-998c2b21d7f9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:22.514704 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-51e0fd38-bd64-46d0-8b78-c441dfe2413b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:22.537836 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-51e0fd38-bd64-46d0-8b78-c441dfe2413b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1510 microversion: 2.1 time: 0.317701 Feb 04 18:03:22.539061 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 173/355] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:22 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1510 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:22.587384 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-8fdf940c-4492-4e37-8634-998c2b21d7f9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:22.594825 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-8fdf940c-4492-4e37-8634-998c2b21d7f9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1507 microversion: 2.1 time: 0.285557 Feb 04 18:03:22.600113 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 183/356] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:22 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1507 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:03:23.554686 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e3bebf53-4520-4136-9c59-e397eb857f8e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:23.555304 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-e3bebf53-4520-4136-9c59-e397eb857f8e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:23.561923 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e3bebf53-4520-4136-9c59-e397eb857f8e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:23.562618 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e3bebf53-4520-4136-9c59-e397eb857f8e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:23.563581 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e3bebf53-4520-4136-9c59-e397eb857f8e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:23.564166 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e3bebf53-4520-4136-9c59-e397eb857f8e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:23.766128 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e3bebf53-4520-4136-9c59-e397eb857f8e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:23.784205 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e3bebf53-4520-4136-9c59-e397eb857f8e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1510 microversion: 2.1 time: 0.231722 Feb 04 18:03:23.784737 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 174/357] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:23 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1510 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:24.806567 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-36d2d3a7-c7dc-4012-854d-7c1166e75646 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:24.811825 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-36d2d3a7-c7dc-4012-854d-7c1166e75646 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:24.815373 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-36d2d3a7-c7dc-4012-854d-7c1166e75646 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:24.815914 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-36d2d3a7-c7dc-4012-854d-7c1166e75646 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:24.816784 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-36d2d3a7-c7dc-4012-854d-7c1166e75646 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:24.817319 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-36d2d3a7-c7dc-4012-854d-7c1166e75646 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:25.087807 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-36d2d3a7-c7dc-4012-854d-7c1166e75646 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:25.095696 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-36d2d3a7-c7dc-4012-854d-7c1166e75646 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1516 microversion: 2.1 time: 0.292796 Feb 04 18:03:25.107235 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 184/358] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:24 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1516 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:25.835516 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-d84174ae-f119-4a53-97e8-6d8fdec7c733 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2bb916b7-d11d-4b00-8466-1501ccd6117d"}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:03:25.836820 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-d84174ae-f119-4a53-97e8-6d8fdec7c733 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:25.844400 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d84174ae-f119-4a53-97e8-6d8fdec7c733 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:25.844961 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d84174ae-f119-4a53-97e8-6d8fdec7c733 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:25.845819 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d84174ae-f119-4a53-97e8-6d8fdec7c733 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:25.846264 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d84174ae-f119-4a53-97e8-6d8fdec7c733 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:26.695169 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-d84174ae-f119-4a53-97e8-6d8fdec7c733 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "POST /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.863764 Feb 04 18:03:26.698993 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 175/359] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Feb 4 18:03:25 2022] POST /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments => generated 194 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:03:28.148727 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ada9a700-3dd4-4ebf-8bf0-b2aa2748e2e8 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:28.149336 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ada9a700-3dd4-4ebf-8bf0-b2aa2748e2e8 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:28.157770 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ada9a700-3dd4-4ebf-8bf0-b2aa2748e2e8 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:28.158308 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ada9a700-3dd4-4ebf-8bf0-b2aa2748e2e8 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:28.159266 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ada9a700-3dd4-4ebf-8bf0-b2aa2748e2e8 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:28.160464 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ada9a700-3dd4-4ebf-8bf0-b2aa2748e2e8 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:28.327661 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-ada9a700-3dd4-4ebf-8bf0-b2aa2748e2e8 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:28.335363 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ada9a700-3dd4-4ebf-8bf0-b2aa2748e2e8 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1516 microversion: 2.1 time: 0.190309 Feb 04 18:03:28.336143 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 185/360] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:28 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1516 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:28.353824 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-4337e7c7-56d0-478d-9278-ebfe3d79d02a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ab2ee93-0ffb-4a5f-b48f-484c370dcd1d"}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:03:28.355088 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-4337e7c7-56d0-478d-9278-ebfe3d79d02a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:28.364249 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4337e7c7-56d0-478d-9278-ebfe3d79d02a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:28.364249 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4337e7c7-56d0-478d-9278-ebfe3d79d02a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:28.364249 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4337e7c7-56d0-478d-9278-ebfe3d79d02a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:28.364249 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4337e7c7-56d0-478d-9278-ebfe3d79d02a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:29.403546 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-4337e7c7-56d0-478d-9278-ebfe3d79d02a tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "POST /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.054170 Feb 04 18:03:29.405116 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 176/361] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Feb 4 18:03:28 2022] POST /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments => generated 194 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:03:35.239673 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b740a250-4bd7-4a33-985e-eab24054e974 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Action: 'create', calling method: .version_select at 0x7fe8cc1d8e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-860948762"}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:03:35.253461 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-b740a250-4bd7-4a33-985e-eab24054e974 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Getting quotas for project e2493fd3d7f84ef0ac9f24b259ec02d8. Resources: {'key_pairs'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:03:35.257243 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-b740a250-4bd7-4a33-985e-eab24054e974 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Getting quotas for user 6861d0a7e0154e8da9405d706cde0313 and project e2493fd3d7f84ef0ac9f24b259ec02d8. Resources: {'key_pairs'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:03:35.489628 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-b740a250-4bd7-4a33-985e-eab24054e974 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Getting quotas for project e2493fd3d7f84ef0ac9f24b259ec02d8. Resources: {'key_pairs'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:03:35.493737 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-b740a250-4bd7-4a33-985e-eab24054e974 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Getting quotas for user 6861d0a7e0154e8da9405d706cde0313 and project e2493fd3d7f84ef0ac9f24b259ec02d8. Resources: {'key_pairs'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:03:35.509280 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-b740a250-4bd7-4a33-985e-eab24054e974 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.433774 Feb 04 18:03:35.509892 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 186/362] 10.222.0.98 () {60 vars in 1157 bytes} [Fri Feb 4 18:03:35 2022] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:39.500077 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-0635c379-4b1d-43aa-af87-c539f105c0b0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2bb916b7-d11d-4b00-8466-1501ccd6117d"}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:03:39.501231 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-0635c379-4b1d-43aa-af87-c539f105c0b0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:39.509888 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0635c379-4b1d-43aa-af87-c539f105c0b0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:39.511053 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0635c379-4b1d-43aa-af87-c539f105c0b0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:39.513419 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0635c379-4b1d-43aa-af87-c539f105c0b0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:39.515369 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0635c379-4b1d-43aa-af87-c539f105c0b0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:39.643077 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.wsgi [None req-0635c379-4b1d-43aa-af87-c539f105c0b0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] HTTP exception thrown: Invalid volume: volume 2bb916b7-d11d-4b00-8466-1501ccd6117d is already attached to instances: 25f4875c-4f92-4b9e-8a76-8d80a51f293c Feb 04 18:03:39.644349 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-0635c379-4b1d-43aa-af87-c539f105c0b0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Returning 400 to user: Invalid volume: volume 2bb916b7-d11d-4b00-8466-1501ccd6117d is already attached to instances: 25f4875c-4f92-4b9e-8a76-8d80a51f293c {{(pid=123567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:03:39.645542 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-0635c379-4b1d-43aa-af87-c539f105c0b0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "POST /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.151007 Feb 04 18:03:39.646689 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 177/363] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Feb 4 18:03:39 2022] POST /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments => generated 174 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 04 18:03:39.709051 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-596a752a-f53d-43aa-95ae-48039e4db7df tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:39.709666 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-596a752a-f53d-43aa-95ae-48039e4db7df tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:39.716082 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-596a752a-f53d-43aa-95ae-48039e4db7df tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:39.716534 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-596a752a-f53d-43aa-95ae-48039e4db7df tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:39.717388 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-596a752a-f53d-43aa-95ae-48039e4db7df tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:39.717826 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-596a752a-f53d-43aa-95ae-48039e4db7df tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:39.817105 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.objects.instance [None req-596a752a-f53d-43aa-95ae-48039e4db7df tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lazy-loading 'services' on Instance uuid 25f4875c-4f92-4b9e-8a76-8d80a51f293c {{(pid=123566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:03:40.105051 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-596a752a-f53d-43aa-95ae-48039e4db7df tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "DELETE /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments/2bb916b7-d11d-4b00-8466-1501ccd6117d" status: 202 len: 0 microversion: 2.1 time: 0.399568 Feb 04 18:03:40.105682 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 187/364] 10.222.0.98 () {58 vars in 1415 bytes} [Fri Feb 4 18:03:39 2022] DELETE /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments/2bb916b7-d11d-4b00-8466-1501ccd6117d => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 04 18:03:40.115064 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e341ee5f-cfd9-4646-8465-54eaa9a2de14 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:40.116003 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-e341ee5f-cfd9-4646-8465-54eaa9a2de14 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:40.125119 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e341ee5f-cfd9-4646-8465-54eaa9a2de14 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:40.126078 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e341ee5f-cfd9-4646-8465-54eaa9a2de14 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:40.127018 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e341ee5f-cfd9-4646-8465-54eaa9a2de14 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:40.127571 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e341ee5f-cfd9-4646-8465-54eaa9a2de14 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:40.159508 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e341ee5f-cfd9-4646-8465-54eaa9a2de14 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048712 Feb 04 18:03:40.160089 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 178/365] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:03:40 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:03:41.172105 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-93e79a08-27ff-40cc-8945-8c16ad460778 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:41.173143 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-93e79a08-27ff-40cc-8945-8c16ad460778 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:41.179279 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-93e79a08-27ff-40cc-8945-8c16ad460778 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:41.179732 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-93e79a08-27ff-40cc-8945-8c16ad460778 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:41.180510 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-93e79a08-27ff-40cc-8945-8c16ad460778 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:41.180943 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-93e79a08-27ff-40cc-8945-8c16ad460778 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:41.211089 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-93e79a08-27ff-40cc-8945-8c16ad460778 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044219 Feb 04 18:03:41.211580 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 188/366] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:03:41 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:03:42.222826 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-697f04ef-6ca9-4b40-aa59-0984094291fe tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:42.223768 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-697f04ef-6ca9-4b40-aa59-0984094291fe tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:42.230181 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-697f04ef-6ca9-4b40-aa59-0984094291fe tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:42.230720 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-697f04ef-6ca9-4b40-aa59-0984094291fe tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:42.231660 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-697f04ef-6ca9-4b40-aa59-0984094291fe tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:42.232098 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-697f04ef-6ca9-4b40-aa59-0984094291fe tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:42.261514 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-697f04ef-6ca9-4b40-aa59-0984094291fe tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042370 Feb 04 18:03:42.262260 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 179/367] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:03:42 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:03:43.273180 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-203b7a8a-a885-4c1c-be87-054096d50b99 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:43.274089 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-203b7a8a-a885-4c1c-be87-054096d50b99 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:43.280591 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-203b7a8a-a885-4c1c-be87-054096d50b99 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:43.281048 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-203b7a8a-a885-4c1c-be87-054096d50b99 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:43.281826 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-203b7a8a-a885-4c1c-be87-054096d50b99 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:43.282263 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-203b7a8a-a885-4c1c-be87-054096d50b99 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:43.312551 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-203b7a8a-a885-4c1c-be87-054096d50b99 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043088 Feb 04 18:03:43.316275 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 189/368] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:03:43 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:03:44.323477 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3b3c3052-92a2-4697-b9b9-16a36e6a2f63 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:44.324450 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-3b3c3052-92a2-4697-b9b9-16a36e6a2f63 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:44.331105 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3b3c3052-92a2-4697-b9b9-16a36e6a2f63 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:44.331648 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3b3c3052-92a2-4697-b9b9-16a36e6a2f63 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:44.332540 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3b3c3052-92a2-4697-b9b9-16a36e6a2f63 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:44.333053 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3b3c3052-92a2-4697-b9b9-16a36e6a2f63 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:44.366236 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-3b3c3052-92a2-4697-b9b9-16a36e6a2f63 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046766 Feb 04 18:03:44.366945 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 180/369] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:03:44 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:03:45.379952 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-2c6b9b1a-8f85-4708-9b92-4012826e17d3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:45.381146 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-2c6b9b1a-8f85-4708-9b92-4012826e17d3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:45.387982 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2c6b9b1a-8f85-4708-9b92-4012826e17d3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:45.388444 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2c6b9b1a-8f85-4708-9b92-4012826e17d3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:45.389828 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2c6b9b1a-8f85-4708-9b92-4012826e17d3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:45.390272 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2c6b9b1a-8f85-4708-9b92-4012826e17d3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:45.422121 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-2c6b9b1a-8f85-4708-9b92-4012826e17d3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046999 Feb 04 18:03:45.422949 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 190/370] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:03:45 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:03:46.441203 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b64f099c-c3ba-4125-860a-7dc7b6fb61f4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:46.442834 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-b64f099c-c3ba-4125-860a-7dc7b6fb61f4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:46.452100 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b64f099c-c3ba-4125-860a-7dc7b6fb61f4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:46.452100 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b64f099c-c3ba-4125-860a-7dc7b6fb61f4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:46.452100 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b64f099c-c3ba-4125-860a-7dc7b6fb61f4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:46.452930 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b64f099c-c3ba-4125-860a-7dc7b6fb61f4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:46.499322 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b64f099c-c3ba-4125-860a-7dc7b6fb61f4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061203 Feb 04 18:03:46.502956 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 181/371] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:03:46 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:03:47.509805 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-30a16392-8402-4273-bf11-08e3e708d284 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:47.510755 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-30a16392-8402-4273-bf11-08e3e708d284 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:47.516892 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-30a16392-8402-4273-bf11-08e3e708d284 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:47.517550 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-30a16392-8402-4273-bf11-08e3e708d284 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:47.518551 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-30a16392-8402-4273-bf11-08e3e708d284 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:47.519160 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-30a16392-8402-4273-bf11-08e3e708d284 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:47.551454 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-30a16392-8402-4273-bf11-08e3e708d284 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045273 Feb 04 18:03:47.552141 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 191/372] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:03:47 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:03:48.195341 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-8a1a9003-a3cd-4c83-9aea-9a49b8d239c8 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:03:48.197466 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-8a1a9003-a3cd-4c83-9aea-9a49b8d239c8 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:48.205375 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8a1a9003-a3cd-4c83-9aea-9a49b8d239c8 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:48.212346 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8a1a9003-a3cd-4c83-9aea-9a49b8d239c8 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:48.212346 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8a1a9003-a3cd-4c83-9aea-9a49b8d239c8 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:48.212346 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8a1a9003-a3cd-4c83-9aea-9a49b8d239c8 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:48.251809 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.objects.instance [None req-8a1a9003-a3cd-4c83-9aea-9a49b8d239c8 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lazy-loading 'flavor' on Instance uuid 16b81832-5021-4cd2-8ebf-767daeb17673 {{(pid=123567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:03:48.585627 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-3a69ec58-9b40-456c-bee0-b81b8de5590e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:48.585627 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-3a69ec58-9b40-456c-bee0-b81b8de5590e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:48.585627 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3a69ec58-9b40-456c-bee0-b81b8de5590e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:48.585627 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3a69ec58-9b40-456c-bee0-b81b8de5590e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:48.586502 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3a69ec58-9b40-456c-bee0-b81b8de5590e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:48.586502 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3a69ec58-9b40-456c-bee0-b81b8de5590e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:48.601896 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-3a69ec58-9b40-456c-bee0-b81b8de5590e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042414 Feb 04 18:03:48.602474 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 192/373] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:03:48 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:03:49.003757 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-8a1a9003-a3cd-4c83-9aea-9a49b8d239c8 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "POST /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/action" status: 200 len: 32 microversion: 2.1 time: 0.812062 Feb 04 18:03:49.004367 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 182/374] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Feb 4 18:03:48 2022] POST /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/action => generated 32 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 04 18:03:49.013436 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-1596ac29-8cd7-41af-9187-ce166aa05c17 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:49.014044 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-1596ac29-8cd7-41af-9187-ce166aa05c17 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:49.020307 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1596ac29-8cd7-41af-9187-ce166aa05c17 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:49.020761 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1596ac29-8cd7-41af-9187-ce166aa05c17 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:49.021580 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1596ac29-8cd7-41af-9187-ce166aa05c17 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:49.022024 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1596ac29-8cd7-41af-9187-ce166aa05c17 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:49.180411 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-1596ac29-8cd7-41af-9187-ce166aa05c17 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:49.188258 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-1596ac29-8cd7-41af-9187-ce166aa05c17 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1568 microversion: 2.1 time: 0.178652 Feb 04 18:03:49.188822 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 193/375] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:49 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:49.614377 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-8557e160-a83b-4595-bd43-439ae0f4d2a5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:49.615405 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-8557e160-a83b-4595-bd43-439ae0f4d2a5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:49.621912 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8557e160-a83b-4595-bd43-439ae0f4d2a5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:49.622371 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8557e160-a83b-4595-bd43-439ae0f4d2a5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:49.623191 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8557e160-a83b-4595-bd43-439ae0f4d2a5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:49.623656 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8557e160-a83b-4595-bd43-439ae0f4d2a5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:49.660654 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-8557e160-a83b-4595-bd43-439ae0f4d2a5 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048036 Feb 04 18:03:49.660654 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 183/376] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:03:49 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:03:50.205407 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ae7e2532-4188-45ad-8bcc-f978ef3bc8f2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:50.206009 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ae7e2532-4188-45ad-8bcc-f978ef3bc8f2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:50.212539 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ae7e2532-4188-45ad-8bcc-f978ef3bc8f2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:50.212983 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ae7e2532-4188-45ad-8bcc-f978ef3bc8f2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:50.213742 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ae7e2532-4188-45ad-8bcc-f978ef3bc8f2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:50.214223 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ae7e2532-4188-45ad-8bcc-f978ef3bc8f2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:50.347868 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-ae7e2532-4188-45ad-8bcc-f978ef3bc8f2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:50.355956 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ae7e2532-4188-45ad-8bcc-f978ef3bc8f2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1568 microversion: 2.1 time: 0.154825 Feb 04 18:03:50.356536 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 194/377] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:50 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:50.612403 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-ef6b1d00-a4af-4f95-bbd4-47877037b9a5 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1034500394", "imageRef": "b0fb57f5-967d-4692-94f3-accee37910c3", "flavorRef": "452", "networks": [{"uuid": "0455843b-79c5-48f6-8274-5cd710fb9067"}]}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:03:50.664068 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.network.neutron [None req-ef6b1d00-a4af-4f95-bbd4-47877037b9a5 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] validate_networks() for [('0455843b-79c5-48f6-8274-5cd710fb9067', None, None, None, None, None)] {{(pid=123567) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 04 18:03:50.669392 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-a71a9e2c-5bd3-4706-aa26-9b66adcbe70e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:50.671128 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-a71a9e2c-5bd3-4706-aa26-9b66adcbe70e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:50.677172 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a71a9e2c-5bd3-4706-aa26-9b66adcbe70e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:50.677500 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a71a9e2c-5bd3-4706-aa26-9b66adcbe70e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:50.678286 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a71a9e2c-5bd3-4706-aa26-9b66adcbe70e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:50.678943 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a71a9e2c-5bd3-4706-aa26-9b66adcbe70e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:50.709137 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-a71a9e2c-5bd3-4706-aa26-9b66adcbe70e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043562 Feb 04 18:03:50.709706 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 195/378] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:03:50 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 04 18:03:50.878078 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-0b233d8a-1aaa-476c-9ccd-b1554678a165 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1826431754", "imageRef": "b0fb57f5-967d-4692-94f3-accee37910c3", "flavorRef": "452", "networks": [{"uuid": "3dc2f191-988b-4e16-974b-c84a0b6125d2"}]}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:03:50.930601 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.network.neutron [None req-0b233d8a-1aaa-476c-9ccd-b1554678a165 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] validate_networks() for [('3dc2f191-988b-4e16-974b-c84a0b6125d2', None, None, None, None, None)] {{(pid=123566) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 04 18:03:51.113262 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-ef6b1d00-a4af-4f95-bbd4-47877037b9a5 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Flavor limits 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 04 18:03:51.113752 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-ef6b1d00-a4af-4f95-bbd4-47877037b9a5 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Image limits 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 04 18:03:51.114556 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-ef6b1d00-a4af-4f95-bbd4-47877037b9a5 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Flavor pref 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 04 18:03:51.115005 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-ef6b1d00-a4af-4f95-bbd4-47877037b9a5 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Image pref 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 04 18:03:51.115422 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-ef6b1d00-a4af-4f95-bbd4-47877037b9a5 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 04 18:03:51.124944 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ef6b1d00-a4af-4f95-bbd4-47877037b9a5 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:51.125465 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ef6b1d00-a4af-4f95-bbd4-47877037b9a5 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:51.126356 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ef6b1d00-a4af-4f95-bbd4-47877037b9a5 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:51.127502 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ef6b1d00-a4af-4f95-bbd4-47877037b9a5 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:51.149353 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-ef6b1d00-a4af-4f95-bbd4-47877037b9a5 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Getting quotas for project c5a4531047cd4d73a0ccd2807d2a282e. Resources: {'cores', 'ram', 'instances'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:03:51.153379 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-ef6b1d00-a4af-4f95-bbd4-47877037b9a5 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Getting quotas for user 6ca8827f98ae4e1085ac670f76898113 and project c5a4531047cd4d73a0ccd2807d2a282e. Resources: {'cores', 'ram', 'instances'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:03:51.164476 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-ef6b1d00-a4af-4f95-bbd4-47877037b9a5 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Going to run 1 instances... {{(pid=123567) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 04 18:03:51.166868 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-ef6b1d00-a4af-4f95-bbd4-47877037b9a5 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0fb57f5-967d-4692-94f3-accee37910c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 04 18:03:51.313382 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ef6b1d00-a4af-4f95-bbd4-47877037b9a5 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [8c358e2a-d804-4cd7-a529-7dc771b24ffc] AMQP server on 10.222.0.98:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 04 18:03:51.359528 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-0b233d8a-1aaa-476c-9ccd-b1554678a165 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Flavor limits 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 04 18:03:51.359969 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-0b233d8a-1aaa-476c-9ccd-b1554678a165 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Image limits 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 04 18:03:51.360445 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-0b233d8a-1aaa-476c-9ccd-b1554678a165 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Flavor pref 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 04 18:03:51.360856 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-0b233d8a-1aaa-476c-9ccd-b1554678a165 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Image pref 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 04 18:03:51.361269 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-0b233d8a-1aaa-476c-9ccd-b1554678a165 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 04 18:03:51.372677 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0b233d8a-1aaa-476c-9ccd-b1554678a165 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:51.372677 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0b233d8a-1aaa-476c-9ccd-b1554678a165 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:51.372974 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0b233d8a-1aaa-476c-9ccd-b1554678a165 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:51.373150 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0b233d8a-1aaa-476c-9ccd-b1554678a165 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:51.389341 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-0b233d8a-1aaa-476c-9ccd-b1554678a165 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Getting quotas for project c4a8ffd2aaf14a21a0545cb345ab262f. Resources: {'cores', 'ram', 'instances'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:03:51.393299 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-0b233d8a-1aaa-476c-9ccd-b1554678a165 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Getting quotas for user e9bd306bfd5f4867b300ada22547897f and project c4a8ffd2aaf14a21a0545cb345ab262f. Resources: {'cores', 'ram', 'instances'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:03:51.404274 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-0b233d8a-1aaa-476c-9ccd-b1554678a165 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Going to run 1 instances... {{(pid=123566) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 04 18:03:51.410770 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-0b233d8a-1aaa-476c-9ccd-b1554678a165 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0fb57f5-967d-4692-94f3-accee37910c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 04 18:03:51.526221 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-0b233d8a-1aaa-476c-9ccd-b1554678a165 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.652645 Feb 04 18:03:51.527098 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 196/379] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Feb 4 18:03:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 04 18:03:51.535849 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-dcc0a4a0-b314-457f-8777-df46e3431b76 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:51.536586 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-dcc0a4a0-b314-457f-8777-df46e3431b76 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:51.546587 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dcc0a4a0-b314-457f-8777-df46e3431b76 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:51.547078 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dcc0a4a0-b314-457f-8777-df46e3431b76 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:51.552096 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dcc0a4a0-b314-457f-8777-df46e3431b76 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:51.552096 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dcc0a4a0-b314-457f-8777-df46e3431b76 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:51.708510 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-dcc0a4a0-b314-457f-8777-df46e3431b76 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:51.717793 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-dcc0a4a0-b314-457f-8777-df46e3431b76 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1568 microversion: 2.1 time: 0.188206 Feb 04 18:03:51.718144 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 197/380] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:51 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:51.722666 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b1b2850d-f8db-4f02-832d-affee809ca85 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:51.723269 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-b1b2850d-f8db-4f02-832d-affee809ca85 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:51.777289 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-b1b2850d-f8db-4f02-832d-affee809ca85 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:51.784414 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-b1b2850d-f8db-4f02-832d-affee809ca85 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1218 microversion: 2.1 time: 0.065316 Feb 04 18:03:51.784977 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 198/381] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:51 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:52.322231 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO oslo.messaging._drivers.impl_rabbit [None req-ef6b1d00-a4af-4f95-bbd4-47877037b9a5 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [8c358e2a-d804-4cd7-a529-7dc771b24ffc] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 56968. Feb 04 18:03:52.326570 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-ef6b1d00-a4af-4f95-bbd4-47877037b9a5 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.717638 Feb 04 18:03:52.328032 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 184/382] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Feb 4 18:03:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 04 18:03:52.341155 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-0573459e-e8ca-49d1-a2d3-dd837a378f68 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:52.341813 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-0573459e-e8ca-49d1-a2d3-dd837a378f68 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:52.418065 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-0573459e-e8ca-49d1-a2d3-dd837a378f68 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:52.428584 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-0573459e-e8ca-49d1-a2d3-dd837a378f68 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1219 microversion: 2.1 time: 0.091065 Feb 04 18:03:52.429550 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 199/383] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:52 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:52.735988 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b550a817-5b73-48e2-bc00-4d309bac5182 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:52.736604 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-b550a817-5b73-48e2-bc00-4d309bac5182 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:52.743662 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b550a817-5b73-48e2-bc00-4d309bac5182 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:52.744154 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b550a817-5b73-48e2-bc00-4d309bac5182 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:52.744946 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b550a817-5b73-48e2-bc00-4d309bac5182 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:52.745382 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b550a817-5b73-48e2-bc00-4d309bac5182 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:52.803411 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-04095715-8339-4f37-985e-ea0440753558 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:52.804652 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-04095715-8339-4f37-985e-ea0440753558 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:52.813244 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-04095715-8339-4f37-985e-ea0440753558 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:52.813948 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-04095715-8339-4f37-985e-ea0440753558 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:52.815400 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-04095715-8339-4f37-985e-ea0440753558 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:52.816120 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-04095715-8339-4f37-985e-ea0440753558 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:52.918524 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-04095715-8339-4f37-985e-ea0440753558 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:52.926896 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-04095715-8339-4f37-985e-ea0440753558 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1214 microversion: 2.1 time: 0.128920 Feb 04 18:03:52.927567 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 200/384] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:52 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1214 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:03:52.948234 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-b550a817-5b73-48e2-bc00-4d309bac5182 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:52.956390 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b550a817-5b73-48e2-bc00-4d309bac5182 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1568 microversion: 2.1 time: 0.224673 Feb 04 18:03:52.956972 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 185/385] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:52 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:53.448238 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-54269cfc-d339-431c-b4f8-9b140d2d7b63 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:53.448883 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-54269cfc-d339-431c-b4f8-9b140d2d7b63 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:53.526352 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-54269cfc-d339-431c-b4f8-9b140d2d7b63 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:53.535792 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-54269cfc-d339-431c-b4f8-9b140d2d7b63 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1219 microversion: 2.1 time: 0.092651 Feb 04 18:03:53.538061 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 201/386] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:53 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:53.949462 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-064fa286-38e2-4569-85c5-3e4814c98dda tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:53.951367 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-064fa286-38e2-4569-85c5-3e4814c98dda tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:53.963447 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-064fa286-38e2-4569-85c5-3e4814c98dda tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:53.963949 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-064fa286-38e2-4569-85c5-3e4814c98dda tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:53.964736 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-064fa286-38e2-4569-85c5-3e4814c98dda tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:53.965370 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-064fa286-38e2-4569-85c5-3e4814c98dda tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:53.976030 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-4f560be3-bc4d-4b92-b524-c532e61ca3bd tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:53.976683 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-4f560be3-bc4d-4b92-b524-c532e61ca3bd tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:53.983405 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4f560be3-bc4d-4b92-b524-c532e61ca3bd tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:53.987117 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4f560be3-bc4d-4b92-b524-c532e61ca3bd tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:53.987117 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4f560be3-bc4d-4b92-b524-c532e61ca3bd tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:53.987117 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4f560be3-bc4d-4b92-b524-c532e61ca3bd tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:54.052438 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-064fa286-38e2-4569-85c5-3e4814c98dda tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:54.060971 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-064fa286-38e2-4569-85c5-3e4814c98dda tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1270 microversion: 2.1 time: 0.119033 Feb 04 18:03:54.062047 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 186/387] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:53 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1270 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:54.156732 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-4f560be3-bc4d-4b92-b524-c532e61ca3bd tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:54.164493 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-4f560be3-bc4d-4b92-b524-c532e61ca3bd tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1568 microversion: 2.1 time: 0.192743 Feb 04 18:03:54.165065 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 202/388] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:53 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:03:54.553154 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-49c57404-37bc-4db5-971e-2b2824f1f3ce tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:54.553801 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-49c57404-37bc-4db5-971e-2b2824f1f3ce tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:54.559806 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-49c57404-37bc-4db5-971e-2b2824f1f3ce tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:54.562960 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-49c57404-37bc-4db5-971e-2b2824f1f3ce tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:54.562960 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-49c57404-37bc-4db5-971e-2b2824f1f3ce tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:54.562960 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-49c57404-37bc-4db5-971e-2b2824f1f3ce tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:54.633249 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-49c57404-37bc-4db5-971e-2b2824f1f3ce tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:54.640686 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-49c57404-37bc-4db5-971e-2b2824f1f3ce tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1271 microversion: 2.1 time: 0.091136 Feb 04 18:03:54.641263 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 187/389] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:54 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:55.080850 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-3a7f8e89-c596-4051-8074-1e354257de28 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:55.081593 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-3a7f8e89-c596-4051-8074-1e354257de28 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:55.088282 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3a7f8e89-c596-4051-8074-1e354257de28 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:55.088812 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3a7f8e89-c596-4051-8074-1e354257de28 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:55.089696 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3a7f8e89-c596-4051-8074-1e354257de28 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:55.090211 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3a7f8e89-c596-4051-8074-1e354257de28 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:55.180993 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3564e347-67ae-417f-8aac-74adfd41d222 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:55.181614 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-3564e347-67ae-417f-8aac-74adfd41d222 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:55.188580 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3564e347-67ae-417f-8aac-74adfd41d222 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:55.189170 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3564e347-67ae-417f-8aac-74adfd41d222 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:55.190037 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3564e347-67ae-417f-8aac-74adfd41d222 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:55.190587 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3564e347-67ae-417f-8aac-74adfd41d222 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:55.208582 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-3a7f8e89-c596-4051-8074-1e354257de28 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:55.218246 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-3a7f8e89-c596-4051-8074-1e354257de28 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1276 microversion: 2.1 time: 0.141069 Feb 04 18:03:55.219254 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 203/390] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:55 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:55.406663 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-3564e347-67ae-417f-8aac-74adfd41d222 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:55.415854 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-3564e347-67ae-417f-8aac-74adfd41d222 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1568 microversion: 2.1 time: 0.238458 Feb 04 18:03:55.418284 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 188/391] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:55 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:03:55.663284 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-57bc4402-90d6-4a55-addc-a373a4ad5ad3 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:55.663826 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-57bc4402-90d6-4a55-addc-a373a4ad5ad3 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:55.671810 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-57bc4402-90d6-4a55-addc-a373a4ad5ad3 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:55.672342 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-57bc4402-90d6-4a55-addc-a373a4ad5ad3 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:55.673188 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-57bc4402-90d6-4a55-addc-a373a4ad5ad3 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:55.673630 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-57bc4402-90d6-4a55-addc-a373a4ad5ad3 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:55.740254 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-57bc4402-90d6-4a55-addc-a373a4ad5ad3 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:55.749560 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-57bc4402-90d6-4a55-addc-a373a4ad5ad3 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1277 microversion: 2.1 time: 0.089550 Feb 04 18:03:55.751377 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 204/392] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:55 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:56.236379 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-5af28e4c-d0cb-480d-866e-35278e0d879e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:56.236992 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-5af28e4c-d0cb-480d-866e-35278e0d879e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:56.243041 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5af28e4c-d0cb-480d-866e-35278e0d879e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:56.249187 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5af28e4c-d0cb-480d-866e-35278e0d879e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:56.249187 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5af28e4c-d0cb-480d-866e-35278e0d879e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:56.249187 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5af28e4c-d0cb-480d-866e-35278e0d879e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:56.390082 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5af28e4c-d0cb-480d-866e-35278e0d879e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:56.397900 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-5af28e4c-d0cb-480d-866e-35278e0d879e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1318 microversion: 2.1 time: 0.166092 Feb 04 18:03:56.398507 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 189/393] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:56 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:56.432752 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-22286ef2-4677-4405-97ff-b45cb469f512 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:56.433282 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-22286ef2-4677-4405-97ff-b45cb469f512 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:56.439708 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-22286ef2-4677-4405-97ff-b45cb469f512 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:56.440189 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-22286ef2-4677-4405-97ff-b45cb469f512 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:56.440998 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-22286ef2-4677-4405-97ff-b45cb469f512 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:56.441446 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-22286ef2-4677-4405-97ff-b45cb469f512 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:56.542236 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-fc3324e4-7f76-448e-9001-41945065c3ed req-c473c07b-b0fc-4ac7-9fda-b01c46534b93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c35f5dd4-8689-4c1f-b63d-3562678b8e1c", "tag": "dc7e48d9-28db-43df-a99d-b317c0c45623"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:03:56.544336 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:03:56.544336 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:03:56.553223 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-fc3324e4-7f76-448e-9001-41945065c3ed req-c473c07b-b0fc-4ac7-9fda-b01c46534b93 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:56.553770 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-fc3324e4-7f76-448e-9001-41945065c3ed req-c473c07b-b0fc-4ac7-9fda-b01c46534b93 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:56.570215 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-fc3324e4-7f76-448e-9001-41945065c3ed req-c473c07b-b0fc-4ac7-9fda-b01c46534b93 service nova] Creating event network-changed:dc7e48d9-28db-43df-a99d-b317c0c45623 for instance c35f5dd4-8689-4c1f-b63d-3562678b8e1c on hv-cinder-82276 Feb 04 18:03:56.572614 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-fc3324e4-7f76-448e-9001-41945065c3ed req-c473c07b-b0fc-4ac7-9fda-b01c46534b93 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034458 Feb 04 18:03:56.573627 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 190/394] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:03:56.598295 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-22286ef2-4677-4405-97ff-b45cb469f512 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:56.608624 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-22286ef2-4677-4405-97ff-b45cb469f512 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1568 microversion: 2.1 time: 0.179441 Feb 04 18:03:56.609225 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 205/395] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:56 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:03:56.768238 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-ca91a921-a27a-49d7-bf03-5bb361a59802 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:56.769270 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-ca91a921-a27a-49d7-bf03-5bb361a59802 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:56.775966 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ca91a921-a27a-49d7-bf03-5bb361a59802 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:56.776560 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ca91a921-a27a-49d7-bf03-5bb361a59802 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:56.777621 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ca91a921-a27a-49d7-bf03-5bb361a59802 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:56.778248 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ca91a921-a27a-49d7-bf03-5bb361a59802 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:56.935512 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ca91a921-a27a-49d7-bf03-5bb361a59802 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:56.944378 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-ca91a921-a27a-49d7-bf03-5bb361a59802 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1319 microversion: 2.1 time: 0.180980 Feb 04 18:03:56.945059 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 191/396] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:56 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:57.415457 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ea64a045-2b2b-4949-b7b5-b62dcf2bda48 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:57.416078 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ea64a045-2b2b-4949-b7b5-b62dcf2bda48 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:57.423294 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ea64a045-2b2b-4949-b7b5-b62dcf2bda48 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:57.428625 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ea64a045-2b2b-4949-b7b5-b62dcf2bda48 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:57.428625 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ea64a045-2b2b-4949-b7b5-b62dcf2bda48 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:57.428625 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ea64a045-2b2b-4949-b7b5-b62dcf2bda48 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:57.587008 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-ea64a045-2b2b-4949-b7b5-b62dcf2bda48 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:57.597812 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ea64a045-2b2b-4949-b7b5-b62dcf2bda48 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1318 microversion: 2.1 time: 0.185885 Feb 04 18:03:57.607452 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 206/397] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:57 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:57.626058 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-f6a3171f-49f7-4e3b-9420-a1554b3082c2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:57.626964 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-f6a3171f-49f7-4e3b-9420-a1554b3082c2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:57.633495 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f6a3171f-49f7-4e3b-9420-a1554b3082c2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:57.633996 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f6a3171f-49f7-4e3b-9420-a1554b3082c2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:57.634998 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f6a3171f-49f7-4e3b-9420-a1554b3082c2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:57.635441 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f6a3171f-49f7-4e3b-9420-a1554b3082c2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:57.802012 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-f6a3171f-49f7-4e3b-9420-a1554b3082c2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:57.810726 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-f6a3171f-49f7-4e3b-9420-a1554b3082c2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1568 microversion: 2.1 time: 0.188728 Feb 04 18:03:57.812154 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 192/398] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:57 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:57.961418 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-74bf230a-a73e-427c-ad42-6996ebb51b0b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:57.962034 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-74bf230a-a73e-427c-ad42-6996ebb51b0b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:57.971570 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-74bf230a-a73e-427c-ad42-6996ebb51b0b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:57.972128 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-74bf230a-a73e-427c-ad42-6996ebb51b0b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:57.973001 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-74bf230a-a73e-427c-ad42-6996ebb51b0b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:57.973523 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-74bf230a-a73e-427c-ad42-6996ebb51b0b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:58.120025 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-74bf230a-a73e-427c-ad42-6996ebb51b0b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:58.128452 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-74bf230a-a73e-427c-ad42-6996ebb51b0b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1319 microversion: 2.1 time: 0.170626 Feb 04 18:03:58.129035 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 207/399] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:57 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:03:58.588761 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-df8912a3-4cf2-433a-bdad-79485b00dc99 req-4174c5c1-3a0d-460b-a155-fd86db02ba6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03f430b1-a5fe-4f64-9b18-fdcc004bfd4e", "tag": "9be7a7bb-43f1-4a15-908b-750308500bc3"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:03:58.590362 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:03:58.590362 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:03:58.597843 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-df8912a3-4cf2-433a-bdad-79485b00dc99 req-4174c5c1-3a0d-460b-a155-fd86db02ba6e service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:58.598297 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-df8912a3-4cf2-433a-bdad-79485b00dc99 req-4174c5c1-3a0d-460b-a155-fd86db02ba6e service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:58.612924 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-df8912a3-4cf2-433a-bdad-79485b00dc99 req-4174c5c1-3a0d-460b-a155-fd86db02ba6e service nova] Creating event network-changed:9be7a7bb-43f1-4a15-908b-750308500bc3 for instance 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e on hv-cinder-82276 Feb 04 18:03:58.614968 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-1a8e0639-f486-4741-a8df-7cbe33537417 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:58.615585 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-1a8e0639-f486-4741-a8df-7cbe33537417 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:58.618122 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-df8912a3-4cf2-433a-bdad-79485b00dc99 req-4174c5c1-3a0d-460b-a155-fd86db02ba6e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033052 Feb 04 18:03:58.618765 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 193/400] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:03:58.622237 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1a8e0639-f486-4741-a8df-7cbe33537417 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:58.622780 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1a8e0639-f486-4741-a8df-7cbe33537417 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:58.623564 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1a8e0639-f486-4741-a8df-7cbe33537417 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:58.624001 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1a8e0639-f486-4741-a8df-7cbe33537417 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:58.760305 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-1a8e0639-f486-4741-a8df-7cbe33537417 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:58.768421 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-1a8e0639-f486-4741-a8df-7cbe33537417 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1318 microversion: 2.1 time: 0.157341 Feb 04 18:03:58.769124 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 208/401] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:58 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:03:58.827771 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-311ce913-7fcd-49d8-8976-c1594a3d9cdb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:58.828471 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-311ce913-7fcd-49d8-8976-c1594a3d9cdb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:58.835355 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-311ce913-7fcd-49d8-8976-c1594a3d9cdb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:58.835922 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-311ce913-7fcd-49d8-8976-c1594a3d9cdb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:58.836929 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-311ce913-7fcd-49d8-8976-c1594a3d9cdb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:58.837381 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-311ce913-7fcd-49d8-8976-c1594a3d9cdb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:58.974130 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-311ce913-7fcd-49d8-8976-c1594a3d9cdb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:58.982214 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-311ce913-7fcd-49d8-8976-c1594a3d9cdb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1568 microversion: 2.1 time: 0.158732 Feb 04 18:03:58.982786 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 194/402] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:58 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:59.144501 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-5b582570-b8c6-4082-8e94-a0c51969c728 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:59.145182 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-5b582570-b8c6-4082-8e94-a0c51969c728 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:59.151261 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5b582570-b8c6-4082-8e94-a0c51969c728 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:59.151714 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5b582570-b8c6-4082-8e94-a0c51969c728 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:59.153118 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5b582570-b8c6-4082-8e94-a0c51969c728 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:59.153118 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5b582570-b8c6-4082-8e94-a0c51969c728 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:59.284268 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-5b582570-b8c6-4082-8e94-a0c51969c728 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:59.291753 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-5b582570-b8c6-4082-8e94-a0c51969c728 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1319 microversion: 2.1 time: 0.150921 Feb 04 18:03:59.294782 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 209/403] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:59 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:03:59.785470 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-4268efff-3b76-4718-995e-29847c45e5b0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:03:59.786085 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-4268efff-3b76-4718-995e-29847c45e5b0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:03:59.792069 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4268efff-3b76-4718-995e-29847c45e5b0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:59.794596 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4268efff-3b76-4718-995e-29847c45e5b0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:59.794596 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4268efff-3b76-4718-995e-29847c45e5b0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:03:59.794596 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4268efff-3b76-4718-995e-29847c45e5b0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:03:59.955022 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-4268efff-3b76-4718-995e-29847c45e5b0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:03:59.963167 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-4268efff-3b76-4718-995e-29847c45e5b0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1318 microversion: 2.1 time: 0.181812 Feb 04 18:03:59.968725 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 195/404] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:59 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:00.000454 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ee64f750-90cd-4dee-a7ea-80cccb0a51ff tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:00.001803 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ee64f750-90cd-4dee-a7ea-80cccb0a51ff tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:00.007361 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ee64f750-90cd-4dee-a7ea-80cccb0a51ff tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:00.007831 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ee64f750-90cd-4dee-a7ea-80cccb0a51ff tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:00.008594 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ee64f750-90cd-4dee-a7ea-80cccb0a51ff tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:00.009029 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ee64f750-90cd-4dee-a7ea-80cccb0a51ff tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:00.144169 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-ee64f750-90cd-4dee-a7ea-80cccb0a51ff tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:00.152277 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ee64f750-90cd-4dee-a7ea-80cccb0a51ff tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1568 microversion: 2.1 time: 0.156160 Feb 04 18:04:00.152867 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 210/405] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:03:59 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:00.308070 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-50f57e00-b00a-488f-b240-8d94ad8cc58e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:00.308756 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-50f57e00-b00a-488f-b240-8d94ad8cc58e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:00.315085 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-50f57e00-b00a-488f-b240-8d94ad8cc58e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:00.315531 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-50f57e00-b00a-488f-b240-8d94ad8cc58e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:00.316291 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-50f57e00-b00a-488f-b240-8d94ad8cc58e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:00.316723 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-50f57e00-b00a-488f-b240-8d94ad8cc58e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:00.451312 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-50f57e00-b00a-488f-b240-8d94ad8cc58e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:00.458719 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-50f57e00-b00a-488f-b240-8d94ad8cc58e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1319 microversion: 2.1 time: 0.154309 Feb 04 18:04:00.459298 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 196/406] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:00 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:00.979915 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-9bcb1067-dfea-454f-936b-1e16a89eb8e4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:00.980528 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-9bcb1067-dfea-454f-936b-1e16a89eb8e4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:00.986581 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9bcb1067-dfea-454f-936b-1e16a89eb8e4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:00.987031 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9bcb1067-dfea-454f-936b-1e16a89eb8e4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:00.987802 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9bcb1067-dfea-454f-936b-1e16a89eb8e4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:00.988241 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9bcb1067-dfea-454f-936b-1e16a89eb8e4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:01.116852 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-9bcb1067-dfea-454f-936b-1e16a89eb8e4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:01.124500 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-9bcb1067-dfea-454f-936b-1e16a89eb8e4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1318 microversion: 2.1 time: 0.148198 Feb 04 18:04:01.125062 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 211/407] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:00 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:01.168725 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-5dd936a5-286b-410a-9ce7-4e0a8f8220d6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:01.169336 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-5dd936a5-286b-410a-9ce7-4e0a8f8220d6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:01.175890 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5dd936a5-286b-410a-9ce7-4e0a8f8220d6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:01.176339 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5dd936a5-286b-410a-9ce7-4e0a8f8220d6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:01.177138 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5dd936a5-286b-410a-9ce7-4e0a8f8220d6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:01.177551 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5dd936a5-286b-410a-9ce7-4e0a8f8220d6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:01.307143 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5dd936a5-286b-410a-9ce7-4e0a8f8220d6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:01.315399 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-5dd936a5-286b-410a-9ce7-4e0a8f8220d6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1568 microversion: 2.1 time: 0.150297 Feb 04 18:04:01.315971 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 197/408] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:01 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:01.475537 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-f6456f07-6760-4b90-95cc-ccd466b42e50 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:01.476152 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-f6456f07-6760-4b90-95cc-ccd466b42e50 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:01.481918 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f6456f07-6760-4b90-95cc-ccd466b42e50 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:01.482365 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f6456f07-6760-4b90-95cc-ccd466b42e50 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:01.483742 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f6456f07-6760-4b90-95cc-ccd466b42e50 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:01.484181 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f6456f07-6760-4b90-95cc-ccd466b42e50 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:01.615567 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-f6456f07-6760-4b90-95cc-ccd466b42e50 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:01.622773 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-f6456f07-6760-4b90-95cc-ccd466b42e50 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1319 microversion: 2.1 time: 0.150795 Feb 04 18:04:01.623445 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 212/409] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:01 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:02.141635 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-84949f33-845b-4312-a9ce-08639b9b118d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:02.142356 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-84949f33-845b-4312-a9ce-08639b9b118d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:02.148918 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-84949f33-845b-4312-a9ce-08639b9b118d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:02.149337 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-84949f33-845b-4312-a9ce-08639b9b118d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:02.150276 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-84949f33-845b-4312-a9ce-08639b9b118d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:02.150743 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-84949f33-845b-4312-a9ce-08639b9b118d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:02.282820 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-84949f33-845b-4312-a9ce-08639b9b118d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:02.289892 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-84949f33-845b-4312-a9ce-08639b9b118d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1318 microversion: 2.1 time: 0.152618 Feb 04 18:04:02.290476 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 198/410] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:02 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:02.332322 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-eea0191f-1e64-4ed1-b768-23657cc5d775 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:02.332943 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-eea0191f-1e64-4ed1-b768-23657cc5d775 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:02.339359 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-eea0191f-1e64-4ed1-b768-23657cc5d775 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:02.339810 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-eea0191f-1e64-4ed1-b768-23657cc5d775 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:02.340599 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-eea0191f-1e64-4ed1-b768-23657cc5d775 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:02.341047 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-eea0191f-1e64-4ed1-b768-23657cc5d775 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:02.473925 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-eea0191f-1e64-4ed1-b768-23657cc5d775 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:02.481744 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-eea0191f-1e64-4ed1-b768-23657cc5d775 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1568 microversion: 2.1 time: 0.153174 Feb 04 18:04:02.482319 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 213/411] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:02 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:02.638806 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-ab93ce25-b1b2-4cd6-ae43-35afc0ecbe25 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:02.639453 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-ab93ce25-b1b2-4cd6-ae43-35afc0ecbe25 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:02.645339 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ab93ce25-b1b2-4cd6-ae43-35afc0ecbe25 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:02.645785 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ab93ce25-b1b2-4cd6-ae43-35afc0ecbe25 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:02.646604 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ab93ce25-b1b2-4cd6-ae43-35afc0ecbe25 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:02.647048 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ab93ce25-b1b2-4cd6-ae43-35afc0ecbe25 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:02.773428 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ab93ce25-b1b2-4cd6-ae43-35afc0ecbe25 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:02.781213 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-ab93ce25-b1b2-4cd6-ae43-35afc0ecbe25 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1319 microversion: 2.1 time: 0.146081 Feb 04 18:04:02.781787 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 199/412] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:02 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:03.306185 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-2172692d-c545-4c43-8faa-3568046a91f9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:03.306839 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-2172692d-c545-4c43-8faa-3568046a91f9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:03.312802 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2172692d-c545-4c43-8faa-3568046a91f9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:03.313250 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2172692d-c545-4c43-8faa-3568046a91f9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:03.314026 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2172692d-c545-4c43-8faa-3568046a91f9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:03.314499 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2172692d-c545-4c43-8faa-3568046a91f9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:03.447436 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2172692d-c545-4c43-8faa-3568046a91f9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:03.455267 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-2172692d-c545-4c43-8faa-3568046a91f9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1318 microversion: 2.1 time: 0.152664 Feb 04 18:04:03.455828 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 214/413] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:03 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:03.499842 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-eab05f3d-32b7-4622-a567-0f827d875e66 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:03.500474 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-eab05f3d-32b7-4622-a567-0f827d875e66 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:03.506773 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-eab05f3d-32b7-4622-a567-0f827d875e66 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:03.507220 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-eab05f3d-32b7-4622-a567-0f827d875e66 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:03.507994 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-eab05f3d-32b7-4622-a567-0f827d875e66 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:03.508440 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-eab05f3d-32b7-4622-a567-0f827d875e66 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:03.797602 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-338f4e3a-7438-4c0d-bc82-b2dd71613094 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:03.798218 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-338f4e3a-7438-4c0d-bc82-b2dd71613094 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:03.803915 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-338f4e3a-7438-4c0d-bc82-b2dd71613094 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:03.804365 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-338f4e3a-7438-4c0d-bc82-b2dd71613094 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:03.805136 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-338f4e3a-7438-4c0d-bc82-b2dd71613094 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:03.805570 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-338f4e3a-7438-4c0d-bc82-b2dd71613094 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:03.879243 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-eab05f3d-32b7-4622-a567-0f827d875e66 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:03.887310 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-eab05f3d-32b7-4622-a567-0f827d875e66 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1568 microversion: 2.1 time: 0.391690 Feb 04 18:04:03.887892 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 200/414] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:03 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1568 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:03.949288 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-338f4e3a-7438-4c0d-bc82-b2dd71613094 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:03.957071 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-338f4e3a-7438-4c0d-bc82-b2dd71613094 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1319 microversion: 2.1 time: 0.163101 Feb 04 18:04:03.957632 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 215/415] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:03 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:04.472447 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-ab2711ac-afa5-4001-8193-75c198993f43 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:04.473056 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-ab2711ac-afa5-4001-8193-75c198993f43 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:04.478863 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ab2711ac-afa5-4001-8193-75c198993f43 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:04.480812 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ab2711ac-afa5-4001-8193-75c198993f43 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:04.480812 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ab2711ac-afa5-4001-8193-75c198993f43 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:04.480812 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ab2711ac-afa5-4001-8193-75c198993f43 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:04.613932 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ab2711ac-afa5-4001-8193-75c198993f43 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:04.621467 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-ab2711ac-afa5-4001-8193-75c198993f43 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1318 microversion: 2.1 time: 0.152787 Feb 04 18:04:04.622036 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 201/416] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:04 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:04.904921 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-db7e50d4-22c9-4aa5-b8f1-6ca99424e055 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:04.905541 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-db7e50d4-22c9-4aa5-b8f1-6ca99424e055 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:04.911899 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-db7e50d4-22c9-4aa5-b8f1-6ca99424e055 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:04.912342 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-db7e50d4-22c9-4aa5-b8f1-6ca99424e055 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:04.913108 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-db7e50d4-22c9-4aa5-b8f1-6ca99424e055 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:04.913539 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-db7e50d4-22c9-4aa5-b8f1-6ca99424e055 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:04.972960 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-4e56c98a-abb1-418d-9ac5-a4ffe565cf7d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:04.973571 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-4e56c98a-abb1-418d-9ac5-a4ffe565cf7d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:04.979319 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4e56c98a-abb1-418d-9ac5-a4ffe565cf7d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:04.979771 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4e56c98a-abb1-418d-9ac5-a4ffe565cf7d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:04.980552 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4e56c98a-abb1-418d-9ac5-a4ffe565cf7d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:04.980989 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4e56c98a-abb1-418d-9ac5-a4ffe565cf7d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:05.072342 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-db7e50d4-22c9-4aa5-b8f1-6ca99424e055 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:05.080084 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-db7e50d4-22c9-4aa5-b8f1-6ca99424e055 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1568 microversion: 2.1 time: 0.178756 Feb 04 18:04:05.080663 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 216/417] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:04 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:05.138555 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-4e56c98a-abb1-418d-9ac5-a4ffe565cf7d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:05.145952 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-4e56c98a-abb1-418d-9ac5-a4ffe565cf7d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1319 microversion: 2.1 time: 0.176700 Feb 04 18:04:05.146573 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 202/418] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:04 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:05.638484 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b95b5b15-1a78-4029-82ff-4b412c75f457 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:05.639160 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-b95b5b15-1a78-4029-82ff-4b412c75f457 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:05.644937 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b95b5b15-1a78-4029-82ff-4b412c75f457 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:05.645384 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b95b5b15-1a78-4029-82ff-4b412c75f457 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:05.646161 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b95b5b15-1a78-4029-82ff-4b412c75f457 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:05.646628 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b95b5b15-1a78-4029-82ff-4b412c75f457 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:05.776338 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-b95b5b15-1a78-4029-82ff-4b412c75f457 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:05.783882 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-b95b5b15-1a78-4029-82ff-4b412c75f457 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1318 microversion: 2.1 time: 0.149103 Feb 04 18:04:05.784458 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 217/419] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:05 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:06.096938 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-07159331-929f-4f67-99e6-34a390fd6228 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:06.097535 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-07159331-929f-4f67-99e6-34a390fd6228 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:06.103833 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-07159331-929f-4f67-99e6-34a390fd6228 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:06.104277 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-07159331-929f-4f67-99e6-34a390fd6228 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:06.105060 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-07159331-929f-4f67-99e6-34a390fd6228 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:06.105488 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-07159331-929f-4f67-99e6-34a390fd6228 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:06.162881 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-e2665f51-259b-4f3b-8294-b0a277bd2301 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:06.163495 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-e2665f51-259b-4f3b-8294-b0a277bd2301 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:06.169769 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e2665f51-259b-4f3b-8294-b0a277bd2301 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:06.170225 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e2665f51-259b-4f3b-8294-b0a277bd2301 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:06.171641 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e2665f51-259b-4f3b-8294-b0a277bd2301 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:06.172068 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e2665f51-259b-4f3b-8294-b0a277bd2301 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:06.278187 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-07159331-929f-4f67-99e6-34a390fd6228 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:06.286002 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-07159331-929f-4f67-99e6-34a390fd6228 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1568 microversion: 2.1 time: 0.192890 Feb 04 18:04:06.286600 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 203/420] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:06 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:06.338142 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-e2665f51-259b-4f3b-8294-b0a277bd2301 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:06.345954 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-e2665f51-259b-4f3b-8294-b0a277bd2301 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1319 microversion: 2.1 time: 0.186750 Feb 04 18:04:06.346543 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 218/421] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:06 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:06.800328 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-66160262-c40a-47b9-a49b-ea7318ebd1e9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:06.800968 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-66160262-c40a-47b9-a49b-ea7318ebd1e9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:06.806825 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-66160262-c40a-47b9-a49b-ea7318ebd1e9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:06.807281 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-66160262-c40a-47b9-a49b-ea7318ebd1e9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:06.808060 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-66160262-c40a-47b9-a49b-ea7318ebd1e9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:06.808501 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-66160262-c40a-47b9-a49b-ea7318ebd1e9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:06.940643 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-66160262-c40a-47b9-a49b-ea7318ebd1e9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:06.947773 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-66160262-c40a-47b9-a49b-ea7318ebd1e9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1318 microversion: 2.1 time: 0.151104 Feb 04 18:04:06.948336 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 204/422] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:06 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:07.302613 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-39bcb682-a11d-4c9e-8335-3704d372c563 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:07.303219 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-39bcb682-a11d-4c9e-8335-3704d372c563 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:07.309378 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-39bcb682-a11d-4c9e-8335-3704d372c563 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:07.309818 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-39bcb682-a11d-4c9e-8335-3704d372c563 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:07.310614 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-39bcb682-a11d-4c9e-8335-3704d372c563 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:07.311600 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-39bcb682-a11d-4c9e-8335-3704d372c563 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:07.362335 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-1c47eeee-cfe2-4055-a626-2d938afab11b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:07.363247 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-1c47eeee-cfe2-4055-a626-2d938afab11b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:07.369909 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1c47eeee-cfe2-4055-a626-2d938afab11b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:07.370361 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1c47eeee-cfe2-4055-a626-2d938afab11b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:07.371221 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1c47eeee-cfe2-4055-a626-2d938afab11b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:07.371661 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1c47eeee-cfe2-4055-a626-2d938afab11b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:07.472795 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-39bcb682-a11d-4c9e-8335-3704d372c563 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:07.480868 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-39bcb682-a11d-4c9e-8335-3704d372c563 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1568 microversion: 2.1 time: 0.181823 Feb 04 18:04:07.481462 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 219/423] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:07 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:07.533704 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-1c47eeee-cfe2-4055-a626-2d938afab11b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:07.541594 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-1c47eeee-cfe2-4055-a626-2d938afab11b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1319 microversion: 2.1 time: 0.183207 Feb 04 18:04:07.542155 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 205/424] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:07 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:07.965080 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-2f8dfcc4-942c-4356-8628-dbe1b47138fb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:07.965802 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-2f8dfcc4-942c-4356-8628-dbe1b47138fb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:07.972578 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2f8dfcc4-942c-4356-8628-dbe1b47138fb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:07.973034 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2f8dfcc4-942c-4356-8628-dbe1b47138fb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:07.973830 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2f8dfcc4-942c-4356-8628-dbe1b47138fb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:07.974270 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2f8dfcc4-942c-4356-8628-dbe1b47138fb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:08.122136 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2f8dfcc4-942c-4356-8628-dbe1b47138fb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:08.130295 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-2f8dfcc4-942c-4356-8628-dbe1b47138fb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1318 microversion: 2.1 time: 0.168728 Feb 04 18:04:08.130835 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 220/425] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:07 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:08.497870 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-133eb1a5-fd12-4422-9ad8-2c68d3bea257 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:08.499250 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-133eb1a5-fd12-4422-9ad8-2c68d3bea257 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:08.505443 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-133eb1a5-fd12-4422-9ad8-2c68d3bea257 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:08.505939 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-133eb1a5-fd12-4422-9ad8-2c68d3bea257 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:08.506750 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-133eb1a5-fd12-4422-9ad8-2c68d3bea257 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:08.508632 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-133eb1a5-fd12-4422-9ad8-2c68d3bea257 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:08.558468 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-9bccc6e9-0beb-4341-a410-c3abdf860675 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:08.559088 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-9bccc6e9-0beb-4341-a410-c3abdf860675 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:08.570457 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9bccc6e9-0beb-4341-a410-c3abdf860675 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:08.570912 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9bccc6e9-0beb-4341-a410-c3abdf860675 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:08.571707 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9bccc6e9-0beb-4341-a410-c3abdf860675 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:08.572150 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9bccc6e9-0beb-4341-a410-c3abdf860675 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:08.672500 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-133eb1a5-fd12-4422-9ad8-2c68d3bea257 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:08.680991 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-133eb1a5-fd12-4422-9ad8-2c68d3bea257 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1568 microversion: 2.1 time: 0.186671 Feb 04 18:04:08.681586 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 206/426] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:08 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:08.743586 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-9bccc6e9-0beb-4341-a410-c3abdf860675 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:08.751840 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-9bccc6e9-0beb-4341-a410-c3abdf860675 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1319 microversion: 2.1 time: 0.197035 Feb 04 18:04:08.752433 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 221/427] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:08 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:09.147077 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-65f96d50-7452-4d93-817b-1a15766b0dda tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:09.147693 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-65f96d50-7452-4d93-817b-1a15766b0dda tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:09.153578 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-65f96d50-7452-4d93-817b-1a15766b0dda tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:09.154037 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-65f96d50-7452-4d93-817b-1a15766b0dda tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:09.155474 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-65f96d50-7452-4d93-817b-1a15766b0dda tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:09.155923 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-65f96d50-7452-4d93-817b-1a15766b0dda tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:09.284590 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-65f96d50-7452-4d93-817b-1a15766b0dda tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:09.291809 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-65f96d50-7452-4d93-817b-1a15766b0dda tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1318 microversion: 2.1 time: 0.148426 Feb 04 18:04:09.292385 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 207/428] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:09 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:09.697567 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-0961e6fc-933d-40f3-8318-40d0515243da tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:09.698180 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-0961e6fc-933d-40f3-8318-40d0515243da tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:09.705105 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0961e6fc-933d-40f3-8318-40d0515243da tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:09.705505 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0961e6fc-933d-40f3-8318-40d0515243da tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:09.706284 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0961e6fc-933d-40f3-8318-40d0515243da tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:09.706764 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0961e6fc-933d-40f3-8318-40d0515243da tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:09.769039 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a2ebf8e3-ec6a-4aef-a285-e3523dbb3057 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:09.769642 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-a2ebf8e3-ec6a-4aef-a285-e3523dbb3057 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:09.778773 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a2ebf8e3-ec6a-4aef-a285-e3523dbb3057 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:09.778773 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a2ebf8e3-ec6a-4aef-a285-e3523dbb3057 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:09.778773 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a2ebf8e3-ec6a-4aef-a285-e3523dbb3057 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:09.778773 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a2ebf8e3-ec6a-4aef-a285-e3523dbb3057 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:09.878253 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-0961e6fc-933d-40f3-8318-40d0515243da tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:09.885965 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-0961e6fc-933d-40f3-8318-40d0515243da tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1568 microversion: 2.1 time: 0.191980 Feb 04 18:04:09.886785 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 222/429] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:09 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:09.939530 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-a2ebf8e3-ec6a-4aef-a285-e3523dbb3057 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:09.946689 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a2ebf8e3-ec6a-4aef-a285-e3523dbb3057 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1319 microversion: 2.1 time: 0.181287 Feb 04 18:04:09.947249 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 208/430] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:09 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:10.308297 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-41ec7038-0dde-4b97-b481-8db9d146eef0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:10.308934 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-41ec7038-0dde-4b97-b481-8db9d146eef0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:10.315403 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-41ec7038-0dde-4b97-b481-8db9d146eef0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:10.315853 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-41ec7038-0dde-4b97-b481-8db9d146eef0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:10.316621 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-41ec7038-0dde-4b97-b481-8db9d146eef0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:10.317052 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-41ec7038-0dde-4b97-b481-8db9d146eef0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:10.444615 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-41ec7038-0dde-4b97-b481-8db9d146eef0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:10.452406 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-41ec7038-0dde-4b97-b481-8db9d146eef0 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1318 microversion: 2.1 time: 0.147100 Feb 04 18:04:10.452975 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 223/431] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:10 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:10.903082 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-1dfa2623-90d9-40b0-a907-d2e50d9809c5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:10.903686 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-1dfa2623-90d9-40b0-a907-d2e50d9809c5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:10.910404 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1dfa2623-90d9-40b0-a907-d2e50d9809c5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:10.910876 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1dfa2623-90d9-40b0-a907-d2e50d9809c5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:10.911672 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1dfa2623-90d9-40b0-a907-d2e50d9809c5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:10.912104 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1dfa2623-90d9-40b0-a907-d2e50d9809c5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:10.963371 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-510a1598-a4b4-46b3-9ace-b77f7a1457e7 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:10.963988 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-510a1598-a4b4-46b3-9ace-b77f7a1457e7 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:10.970808 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-510a1598-a4b4-46b3-9ace-b77f7a1457e7 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:10.971261 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-510a1598-a4b4-46b3-9ace-b77f7a1457e7 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:10.972040 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-510a1598-a4b4-46b3-9ace-b77f7a1457e7 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:10.972481 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-510a1598-a4b4-46b3-9ace-b77f7a1457e7 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:11.077240 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-1dfa2623-90d9-40b0-a907-d2e50d9809c5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:11.084917 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-1dfa2623-90d9-40b0-a907-d2e50d9809c5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1568 microversion: 2.1 time: 0.185424 Feb 04 18:04:11.085496 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 209/432] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:10 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:11.135229 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-510a1598-a4b4-46b3-9ace-b77f7a1457e7 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:11.142566 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-510a1598-a4b4-46b3-9ace-b77f7a1457e7 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1319 microversion: 2.1 time: 0.182792 Feb 04 18:04:11.143147 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 224/433] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:10 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:11.468826 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3a27641f-150e-4aac-a27a-d458cb67b0bd tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:11.469432 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-3a27641f-150e-4aac-a27a-d458cb67b0bd tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:11.475926 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3a27641f-150e-4aac-a27a-d458cb67b0bd tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:11.476373 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3a27641f-150e-4aac-a27a-d458cb67b0bd tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:11.477137 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3a27641f-150e-4aac-a27a-d458cb67b0bd tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:11.477573 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3a27641f-150e-4aac-a27a-d458cb67b0bd tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:11.607621 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-3a27641f-150e-4aac-a27a-d458cb67b0bd tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:11.615247 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-3a27641f-150e-4aac-a27a-d458cb67b0bd tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1318 microversion: 2.1 time: 0.150065 Feb 04 18:04:11.615817 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 210/434] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:11 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:12.102344 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-5f7880ea-db69-430f-975a-294cdd4dab90 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:12.102953 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-5f7880ea-db69-430f-975a-294cdd4dab90 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:12.109658 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5f7880ea-db69-430f-975a-294cdd4dab90 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:12.110099 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5f7880ea-db69-430f-975a-294cdd4dab90 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:12.110915 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5f7880ea-db69-430f-975a-294cdd4dab90 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:12.111342 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5f7880ea-db69-430f-975a-294cdd4dab90 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:12.158861 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-38ba41a5-142a-4df9-878d-21d100224395 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:12.159466 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-38ba41a5-142a-4df9-878d-21d100224395 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:12.165792 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-38ba41a5-142a-4df9-878d-21d100224395 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:12.166237 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-38ba41a5-142a-4df9-878d-21d100224395 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:12.167032 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-38ba41a5-142a-4df9-878d-21d100224395 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:12.167470 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-38ba41a5-142a-4df9-878d-21d100224395 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:12.273411 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-5f7880ea-db69-430f-975a-294cdd4dab90 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:12.281548 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-5f7880ea-db69-430f-975a-294cdd4dab90 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1568 microversion: 2.1 time: 0.182855 Feb 04 18:04:12.282133 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 225/435] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:12 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:12.329081 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-38ba41a5-142a-4df9-878d-21d100224395 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:12.336741 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-38ba41a5-142a-4df9-878d-21d100224395 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1319 microversion: 2.1 time: 0.181424 Feb 04 18:04:12.337342 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 211/436] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:12 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:12.632312 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-834c87be-539f-40d5-bae2-c3ef1c1f9905 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:12.632928 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-834c87be-539f-40d5-bae2-c3ef1c1f9905 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:12.638950 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-834c87be-539f-40d5-bae2-c3ef1c1f9905 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:12.639455 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-834c87be-539f-40d5-bae2-c3ef1c1f9905 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:12.640274 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-834c87be-539f-40d5-bae2-c3ef1c1f9905 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:12.640862 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-834c87be-539f-40d5-bae2-c3ef1c1f9905 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:12.773618 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-834c87be-539f-40d5-bae2-c3ef1c1f9905 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:12.781552 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-834c87be-539f-40d5-bae2-c3ef1c1f9905 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1318 microversion: 2.1 time: 0.152973 Feb 04 18:04:12.782113 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 226/437] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:12 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:13.298562 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-17f34f8b-0a59-4118-ad2c-5cd82b6e40bd tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:13.299170 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-17f34f8b-0a59-4118-ad2c-5cd82b6e40bd tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:13.305451 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-17f34f8b-0a59-4118-ad2c-5cd82b6e40bd tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:13.305903 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-17f34f8b-0a59-4118-ad2c-5cd82b6e40bd tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:13.306717 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-17f34f8b-0a59-4118-ad2c-5cd82b6e40bd tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:13.307159 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-17f34f8b-0a59-4118-ad2c-5cd82b6e40bd tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:13.352951 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-4cbdb10b-3f2e-4aca-8b4c-233d08f50c20 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:13.353569 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-4cbdb10b-3f2e-4aca-8b4c-233d08f50c20 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:13.360548 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4cbdb10b-3f2e-4aca-8b4c-233d08f50c20 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:13.361005 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4cbdb10b-3f2e-4aca-8b4c-233d08f50c20 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:13.361784 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4cbdb10b-3f2e-4aca-8b4c-233d08f50c20 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:13.362224 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4cbdb10b-3f2e-4aca-8b4c-233d08f50c20 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:13.465645 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-17f34f8b-0a59-4118-ad2c-5cd82b6e40bd tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:13.473288 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-17f34f8b-0a59-4118-ad2c-5cd82b6e40bd tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1568 microversion: 2.1 time: 0.178947 Feb 04 18:04:13.473855 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 212/438] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:13 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:13.538093 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-4cbdb10b-3f2e-4aca-8b4c-233d08f50c20 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:13.546005 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-4cbdb10b-3f2e-4aca-8b4c-233d08f50c20 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1319 microversion: 2.1 time: 0.196253 Feb 04 18:04:13.546605 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 227/439] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:13 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:13.798715 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b374e2f4-2e10-4060-a937-99e6de87f6b1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:13.799374 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-b374e2f4-2e10-4060-a937-99e6de87f6b1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:13.805451 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b374e2f4-2e10-4060-a937-99e6de87f6b1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:13.805895 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b374e2f4-2e10-4060-a937-99e6de87f6b1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:13.806705 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b374e2f4-2e10-4060-a937-99e6de87f6b1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:13.807140 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b374e2f4-2e10-4060-a937-99e6de87f6b1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:13.940065 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-b374e2f4-2e10-4060-a937-99e6de87f6b1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:13.947196 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b374e2f4-2e10-4060-a937-99e6de87f6b1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1318 microversion: 2.1 time: 0.152875 Feb 04 18:04:13.947761 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 213/440] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:13 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:14.490376 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-1e75cc09-0c0f-47f0-8329-b97464052409 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:14.491030 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-1e75cc09-0c0f-47f0-8329-b97464052409 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:14.497232 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1e75cc09-0c0f-47f0-8329-b97464052409 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:14.497684 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1e75cc09-0c0f-47f0-8329-b97464052409 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:14.498529 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1e75cc09-0c0f-47f0-8329-b97464052409 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:14.498975 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1e75cc09-0c0f-47f0-8329-b97464052409 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:14.562546 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a08670b2-11a2-40c7-a662-ef4e51c78203 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:14.563159 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-a08670b2-11a2-40c7-a662-ef4e51c78203 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:14.569576 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a08670b2-11a2-40c7-a662-ef4e51c78203 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:14.570037 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a08670b2-11a2-40c7-a662-ef4e51c78203 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:14.570854 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a08670b2-11a2-40c7-a662-ef4e51c78203 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:14.571293 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a08670b2-11a2-40c7-a662-ef4e51c78203 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:14.663730 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-1e75cc09-0c0f-47f0-8329-b97464052409 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:14.671552 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-1e75cc09-0c0f-47f0-8329-b97464052409 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1568 microversion: 2.1 time: 0.185096 Feb 04 18:04:14.672130 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 228/441] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:14 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:14.725795 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-a08670b2-11a2-40c7-a662-ef4e51c78203 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:14.733066 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a08670b2-11a2-40c7-a662-ef4e51c78203 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1319 microversion: 2.1 time: 0.174399 Feb 04 18:04:14.733632 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 214/442] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:14 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:14.963694 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-5fe040d9-5e7d-45be-bfd8-c452752b9d97 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:14.964300 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-5fe040d9-5e7d-45be-bfd8-c452752b9d97 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:14.970250 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5fe040d9-5e7d-45be-bfd8-c452752b9d97 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:14.970726 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5fe040d9-5e7d-45be-bfd8-c452752b9d97 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:14.971499 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5fe040d9-5e7d-45be-bfd8-c452752b9d97 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:14.971935 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5fe040d9-5e7d-45be-bfd8-c452752b9d97 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:15.101343 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-5fe040d9-5e7d-45be-bfd8-c452752b9d97 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:15.109526 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-5fe040d9-5e7d-45be-bfd8-c452752b9d97 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1318 microversion: 2.1 time: 0.149455 Feb 04 18:04:15.110090 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 229/443] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:14 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:15.689172 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-f86d0335-5993-478d-87f4-349dcba3aaa3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:15.689781 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-f86d0335-5993-478d-87f4-349dcba3aaa3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:15.696073 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f86d0335-5993-478d-87f4-349dcba3aaa3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:15.696518 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f86d0335-5993-478d-87f4-349dcba3aaa3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:15.697294 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f86d0335-5993-478d-87f4-349dcba3aaa3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:15.697731 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f86d0335-5993-478d-87f4-349dcba3aaa3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:15.749647 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-5af1ecf5-6690-40b8-9f46-06f1f7d779bb tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:15.750340 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-5af1ecf5-6690-40b8-9f46-06f1f7d779bb tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:15.756714 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5af1ecf5-6690-40b8-9f46-06f1f7d779bb tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:15.757173 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5af1ecf5-6690-40b8-9f46-06f1f7d779bb tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:15.757973 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5af1ecf5-6690-40b8-9f46-06f1f7d779bb tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:15.758438 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5af1ecf5-6690-40b8-9f46-06f1f7d779bb tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:15.867392 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-f86d0335-5993-478d-87f4-349dcba3aaa3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:15.875513 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-f86d0335-5993-478d-87f4-349dcba3aaa3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1568 microversion: 2.1 time: 0.190496 Feb 04 18:04:15.876340 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 215/444] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:15 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:15.930357 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-5af1ecf5-6690-40b8-9f46-06f1f7d779bb tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:15.937906 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-5af1ecf5-6690-40b8-9f46-06f1f7d779bb tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1319 microversion: 2.1 time: 0.192590 Feb 04 18:04:15.938500 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 230/445] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:15 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:16.126869 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-62f30d63-18b9-4cf0-a93e-372913ac691d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:16.127469 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-62f30d63-18b9-4cf0-a93e-372913ac691d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:16.133230 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-62f30d63-18b9-4cf0-a93e-372913ac691d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:16.133677 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-62f30d63-18b9-4cf0-a93e-372913ac691d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:16.134479 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-62f30d63-18b9-4cf0-a93e-372913ac691d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:16.134916 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-62f30d63-18b9-4cf0-a93e-372913ac691d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:16.272221 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-62f30d63-18b9-4cf0-a93e-372913ac691d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:16.279560 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-62f30d63-18b9-4cf0-a93e-372913ac691d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1318 microversion: 2.1 time: 0.156970 Feb 04 18:04:16.280230 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 216/446] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:16 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:16.892723 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-387cc7b5-896c-46f0-b955-bb8220ecbe30 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:16.893261 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-387cc7b5-896c-46f0-b955-bb8220ecbe30 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:16.899601 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-387cc7b5-896c-46f0-b955-bb8220ecbe30 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:16.900058 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-387cc7b5-896c-46f0-b955-bb8220ecbe30 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:16.900918 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-387cc7b5-896c-46f0-b955-bb8220ecbe30 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:16.901357 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-387cc7b5-896c-46f0-b955-bb8220ecbe30 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:16.954576 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-2f5d572c-6e54-4f2d-a54b-46af99b256fc tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:16.955195 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-2f5d572c-6e54-4f2d-a54b-46af99b256fc tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:16.961230 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2f5d572c-6e54-4f2d-a54b-46af99b256fc tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:16.961680 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2f5d572c-6e54-4f2d-a54b-46af99b256fc tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:16.962517 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2f5d572c-6e54-4f2d-a54b-46af99b256fc tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:16.962953 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2f5d572c-6e54-4f2d-a54b-46af99b256fc tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:17.075167 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-387cc7b5-896c-46f0-b955-bb8220ecbe30 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:17.083263 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-387cc7b5-896c-46f0-b955-bb8220ecbe30 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1568 microversion: 2.1 time: 0.194378 Feb 04 18:04:17.083853 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 231/447] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:16 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:17.135414 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-2f5d572c-6e54-4f2d-a54b-46af99b256fc tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:17.143666 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-2f5d572c-6e54-4f2d-a54b-46af99b256fc tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1319 microversion: 2.1 time: 0.192970 Feb 04 18:04:17.144190 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 217/448] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:16 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:17.296063 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-7e2f4047-b0a2-460e-8285-f10e9ca5fc4c tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:17.296664 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-7e2f4047-b0a2-460e-8285-f10e9ca5fc4c tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:17.302845 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7e2f4047-b0a2-460e-8285-f10e9ca5fc4c tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:17.303296 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7e2f4047-b0a2-460e-8285-f10e9ca5fc4c tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:17.304082 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7e2f4047-b0a2-460e-8285-f10e9ca5fc4c tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:17.304519 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7e2f4047-b0a2-460e-8285-f10e9ca5fc4c tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:17.442687 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-7e2f4047-b0a2-460e-8285-f10e9ca5fc4c tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:17.449958 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-7e2f4047-b0a2-460e-8285-f10e9ca5fc4c tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1318 microversion: 2.1 time: 0.157660 Feb 04 18:04:17.450772 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 232/449] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:17 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:18.101126 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-6274b83e-8bbc-4750-a5a2-fd5930cc7aed tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:18.101649 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-6274b83e-8bbc-4750-a5a2-fd5930cc7aed tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:18.108922 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6274b83e-8bbc-4750-a5a2-fd5930cc7aed tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:18.109379 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6274b83e-8bbc-4750-a5a2-fd5930cc7aed tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:18.110235 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6274b83e-8bbc-4750-a5a2-fd5930cc7aed tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:18.110701 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6274b83e-8bbc-4750-a5a2-fd5930cc7aed tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:18.160476 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-6b5392ad-e97e-420a-88d2-d0dbfbf9e55f tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:18.161097 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-6b5392ad-e97e-420a-88d2-d0dbfbf9e55f tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:18.167102 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6b5392ad-e97e-420a-88d2-d0dbfbf9e55f tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:18.167556 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6b5392ad-e97e-420a-88d2-d0dbfbf9e55f tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:18.168637 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6b5392ad-e97e-420a-88d2-d0dbfbf9e55f tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:18.169716 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6b5392ad-e97e-420a-88d2-d0dbfbf9e55f tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:18.283883 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-6274b83e-8bbc-4750-a5a2-fd5930cc7aed tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:18.292043 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-6274b83e-8bbc-4750-a5a2-fd5930cc7aed tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1568 microversion: 2.1 time: 0.194715 Feb 04 18:04:18.293088 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 218/450] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:18 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:18.357778 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-6b5392ad-e97e-420a-88d2-d0dbfbf9e55f tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:18.366475 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-6b5392ad-e97e-420a-88d2-d0dbfbf9e55f tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1319 microversion: 2.1 time: 0.209749 Feb 04 18:04:18.367075 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 233/451] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:18 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:18.467942 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e8d98a61-533d-4d11-9410-1ed542d9557a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:18.468648 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-e8d98a61-533d-4d11-9410-1ed542d9557a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:18.474441 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e8d98a61-533d-4d11-9410-1ed542d9557a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:18.474889 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e8d98a61-533d-4d11-9410-1ed542d9557a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:18.475663 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e8d98a61-533d-4d11-9410-1ed542d9557a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:18.476092 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e8d98a61-533d-4d11-9410-1ed542d9557a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:18.610077 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e8d98a61-533d-4d11-9410-1ed542d9557a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:18.617857 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e8d98a61-533d-4d11-9410-1ed542d9557a tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1318 microversion: 2.1 time: 0.154053 Feb 04 18:04:18.618450 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 219/452] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:18 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:18.791747 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-43868f28-3896-4bef-b14a-7c24b8c00e25 req-10a7059d-ff38-4107-89c2-f9962c84e9f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c35f5dd4-8689-4c1f-b63d-3562678b8e1c", "name": "network-vif-plugged", "status": "completed", "tag": "dc7e48d9-28db-43df-a99d-b317c0c45623"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:04:18.796045 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:04:18.796045 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:04:18.801074 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-43868f28-3896-4bef-b14a-7c24b8c00e25 req-10a7059d-ff38-4107-89c2-f9962c84e9f0 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:18.801589 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-43868f28-3896-4bef-b14a-7c24b8c00e25 req-10a7059d-ff38-4107-89c2-f9962c84e9f0 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:18.813157 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-43868f28-3896-4bef-b14a-7c24b8c00e25 req-10a7059d-ff38-4107-89c2-f9962c84e9f0 service nova] Creating event network-vif-plugged:dc7e48d9-28db-43df-a99d-b317c0c45623 for instance c35f5dd4-8689-4c1f-b63d-3562678b8e1c on hv-cinder-82276 Feb 04 18:04:18.818074 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-43868f28-3896-4bef-b14a-7c24b8c00e25 req-10a7059d-ff38-4107-89c2-f9962c84e9f0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030010 Feb 04 18:04:18.818690 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 234/453] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:04:19.309379 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-d68921c7-0444-4b7c-b6ec-884e750be5ae tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:19.309962 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-d68921c7-0444-4b7c-b6ec-884e750be5ae tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:19.315877 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d68921c7-0444-4b7c-b6ec-884e750be5ae tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:19.316319 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d68921c7-0444-4b7c-b6ec-884e750be5ae tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:19.317089 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d68921c7-0444-4b7c-b6ec-884e750be5ae tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:19.317518 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d68921c7-0444-4b7c-b6ec-884e750be5ae tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:19.383869 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-9b24c8ab-d6e9-40de-be2f-d40e30ab8a0d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:19.384614 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-9b24c8ab-d6e9-40de-be2f-d40e30ab8a0d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:19.392536 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9b24c8ab-d6e9-40de-be2f-d40e30ab8a0d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:19.392998 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9b24c8ab-d6e9-40de-be2f-d40e30ab8a0d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:19.393800 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9b24c8ab-d6e9-40de-be2f-d40e30ab8a0d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:19.394246 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9b24c8ab-d6e9-40de-be2f-d40e30ab8a0d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:19.483046 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-d68921c7-0444-4b7c-b6ec-884e750be5ae tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:19.491297 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-d68921c7-0444-4b7c-b6ec-884e750be5ae tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1568 microversion: 2.1 time: 0.185492 Feb 04 18:04:19.491880 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 220/454] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:19 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:19.558036 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-9b24c8ab-d6e9-40de-be2f-d40e30ab8a0d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:19.565663 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-9b24c8ab-d6e9-40de-be2f-d40e30ab8a0d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1319 microversion: 2.1 time: 0.185970 Feb 04 18:04:19.566440 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 235/455] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:19 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:19.634639 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-0ab495dc-4061-4afc-ba09-f4492c8af86f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:19.635244 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-0ab495dc-4061-4afc-ba09-f4492c8af86f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:19.641717 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0ab495dc-4061-4afc-ba09-f4492c8af86f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:19.642162 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0ab495dc-4061-4afc-ba09-f4492c8af86f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:19.642978 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0ab495dc-4061-4afc-ba09-f4492c8af86f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:19.643415 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0ab495dc-4061-4afc-ba09-f4492c8af86f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:19.779590 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-0ab495dc-4061-4afc-ba09-f4492c8af86f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:19.787565 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-0ab495dc-4061-4afc-ba09-f4492c8af86f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1318 microversion: 2.1 time: 0.156654 Feb 04 18:04:19.790390 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 221/456] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:19 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:20.332356 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-a84b4c7d-8790-4b07-8ed0-0eecfdba906e tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-20383355", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-860948762", "security_groups": [{"name": "tempest-secgroup-smoke-1979864658"}], "networks": [{"uuid": "292f6a38-4bca-48ca-b116-76ea4926f066"}], "block_device_mapping_v2": [{"uuid": "f4ab1052-080a-4ece-a73b-501960650104", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:04:20.440186 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.network.neutron [None req-a84b4c7d-8790-4b07-8ed0-0eecfdba906e tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] validate_networks() for [('292f6a38-4bca-48ca-b116-76ea4926f066', None, None, None, None, None)] {{(pid=123566) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 04 18:04:20.509679 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-29eaab39-55cd-49bd-aab4-949b65892c49 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:20.512330 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-29eaab39-55cd-49bd-aab4-949b65892c49 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:20.523617 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-29eaab39-55cd-49bd-aab4-949b65892c49 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:20.524064 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-29eaab39-55cd-49bd-aab4-949b65892c49 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:20.524856 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-29eaab39-55cd-49bd-aab4-949b65892c49 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:20.525294 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-29eaab39-55cd-49bd-aab4-949b65892c49 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:20.776236 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-29eaab39-55cd-49bd-aab4-949b65892c49 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:20.785548 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-29eaab39-55cd-49bd-aab4-949b65892c49 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1568 microversion: 2.1 time: 0.280325 Feb 04 18:04:20.786432 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 222/457] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:20 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1568 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:20.791262 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-98dcf5e1-682f-4b0e-b6b6-ab98dc3f613d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:20.795273 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-98dcf5e1-682f-4b0e-b6b6-ab98dc3f613d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:20.799009 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-98dcf5e1-682f-4b0e-b6b6-ab98dc3f613d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:20.799674 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-98dcf5e1-682f-4b0e-b6b6-ab98dc3f613d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:20.800473 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-98dcf5e1-682f-4b0e-b6b6-ab98dc3f613d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:20.801062 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-98dcf5e1-682f-4b0e-b6b6-ab98dc3f613d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:20.952604 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-a84b4c7d-8790-4b07-8ed0-0eecfdba906e tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Flavor limits 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 04 18:04:20.953132 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-a84b4c7d-8790-4b07-8ed0-0eecfdba906e tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Image limits 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 04 18:04:20.953714 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-a84b4c7d-8790-4b07-8ed0-0eecfdba906e tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Flavor pref 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 04 18:04:20.954158 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-a84b4c7d-8790-4b07-8ed0-0eecfdba906e tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Image pref 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 04 18:04:20.955214 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-a84b4c7d-8790-4b07-8ed0-0eecfdba906e tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 04 18:04:20.965565 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a84b4c7d-8790-4b07-8ed0-0eecfdba906e tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:20.966044 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a84b4c7d-8790-4b07-8ed0-0eecfdba906e tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:20.966897 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a84b4c7d-8790-4b07-8ed0-0eecfdba906e tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:20.967372 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a84b4c7d-8790-4b07-8ed0-0eecfdba906e tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:20.985743 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-a84b4c7d-8790-4b07-8ed0-0eecfdba906e tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Getting quotas for project e2493fd3d7f84ef0ac9f24b259ec02d8. Resources: {'cores', 'ram', 'instances'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:04:20.991815 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-a84b4c7d-8790-4b07-8ed0-0eecfdba906e tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Getting quotas for user 6861d0a7e0154e8da9405d706cde0313 and project e2493fd3d7f84ef0ac9f24b259ec02d8. Resources: {'cores', 'ram', 'instances'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:04:21.003881 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-98dcf5e1-682f-4b0e-b6b6-ab98dc3f613d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:21.013432 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-98dcf5e1-682f-4b0e-b6b6-ab98dc3f613d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1319 microversion: 2.1 time: 0.225708 Feb 04 18:04:21.014750 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 223/458] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:20 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:21.027721 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e6391da1-9528-47ab-9343-1d394b02c01e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:21.028331 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-e6391da1-9528-47ab-9343-1d394b02c01e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:21.035031 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e6391da1-9528-47ab-9343-1d394b02c01e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:21.035484 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e6391da1-9528-47ab-9343-1d394b02c01e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:21.036267 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e6391da1-9528-47ab-9343-1d394b02c01e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:21.036712 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e6391da1-9528-47ab-9343-1d394b02c01e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:21.049136 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-a84b4c7d-8790-4b07-8ed0-0eecfdba906e tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Going to run 1 instances... {{(pid=123566) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 04 18:04:21.051288 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-a84b4c7d-8790-4b07-8ed0-0eecfdba906e tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f4ab1052-080a-4ece-a73b-501960650104',volume_size=None,volume_type=None)] {{(pid=123566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 04 18:04:21.179083 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e6391da1-9528-47ab-9343-1d394b02c01e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:21.186348 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e6391da1-9528-47ab-9343-1d394b02c01e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1318 microversion: 2.1 time: 0.162227 Feb 04 18:04:21.186947 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 224/459] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:21 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:21.191217 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-6a45e768-a1ef-4820-9ecd-0811ae300b84 req-d0adc468-fccd-4649-aae8-e9ffabe06820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f430b1-a5fe-4f64-9b18-fdcc004bfd4e", "name": "network-vif-plugged", "status": "completed", "tag": "9be7a7bb-43f1-4a15-908b-750308500bc3"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:04:21.192776 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:04:21.192776 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:04:21.199501 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-6a45e768-a1ef-4820-9ecd-0811ae300b84 req-d0adc468-fccd-4649-aae8-e9ffabe06820 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:21.199865 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-6a45e768-a1ef-4820-9ecd-0811ae300b84 req-d0adc468-fccd-4649-aae8-e9ffabe06820 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:21.211242 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-6a45e768-a1ef-4820-9ecd-0811ae300b84 req-d0adc468-fccd-4649-aae8-e9ffabe06820 service nova] Creating event network-vif-plugged:9be7a7bb-43f1-4a15-908b-750308500bc3 for instance 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e on hv-cinder-82276 Feb 04 18:04:21.216147 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-6a45e768-a1ef-4820-9ecd-0811ae300b84 req-d0adc468-fccd-4649-aae8-e9ffabe06820 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028120 Feb 04 18:04:21.216732 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 225/460] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:04:21.465099 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-a84b4c7d-8790-4b07-8ed0-0eecfdba906e tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.136423 Feb 04 18:04:21.465875 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 236/461] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Feb 4 18:04:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 04 18:04:21.476202 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c3c03b9c-9186-470c-a25c-a3d674b42380 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:21.477015 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c3c03b9c-9186-470c-a25c-a3d674b42380 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:21.531351 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c3c03b9c-9186-470c-a25c-a3d674b42380 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:21.538391 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c3c03b9c-9186-470c-a25c-a3d674b42380 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1086 microversion: 2.1 time: 0.066134 Feb 04 18:04:21.539141 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 226/462] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:21 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1086 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:21.802576 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-3da208f2-ee15-4d4d-ac2a-200a4abc0262 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:21.803185 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-3da208f2-ee15-4d4d-ac2a-200a4abc0262 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:21.809457 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3da208f2-ee15-4d4d-ac2a-200a4abc0262 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:21.809911 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3da208f2-ee15-4d4d-ac2a-200a4abc0262 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:21.810727 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3da208f2-ee15-4d4d-ac2a-200a4abc0262 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:21.811210 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3da208f2-ee15-4d4d-ac2a-200a4abc0262 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:21.946322 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-3da208f2-ee15-4d4d-ac2a-200a4abc0262 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:21.954124 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-3da208f2-ee15-4d4d-ac2a-200a4abc0262 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1548 microversion: 2.1 time: 0.155529 Feb 04 18:04:21.954738 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 237/463] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:21 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:21.979062 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-11d4b48b-e73c-4049-bce6-14ce63509dac tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:21.979601 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-11d4b48b-e73c-4049-bce6-14ce63509dac tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:21.986349 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-11d4b48b-e73c-4049-bce6-14ce63509dac tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:21.986829 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-11d4b48b-e73c-4049-bce6-14ce63509dac tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:21.987603 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-11d4b48b-e73c-4049-bce6-14ce63509dac tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:21.988037 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-11d4b48b-e73c-4049-bce6-14ce63509dac tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:22.030935 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-19d1df5d-b50e-4ba6-b9a7-9dbaef901931 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:22.031924 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-19d1df5d-b50e-4ba6-b9a7-9dbaef901931 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:22.038807 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-19d1df5d-b50e-4ba6-b9a7-9dbaef901931 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:22.039263 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-19d1df5d-b50e-4ba6-b9a7-9dbaef901931 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:22.040208 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-19d1df5d-b50e-4ba6-b9a7-9dbaef901931 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:22.040650 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-19d1df5d-b50e-4ba6-b9a7-9dbaef901931 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:22.112894 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.wsgi [None req-11d4b48b-e73c-4049-bce6-14ce63509dac tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] HTTP exception thrown: Cannot 'detach_volume' instance 16b81832-5021-4cd2-8ebf-767daeb17673 while it is in vm_state rescued Feb 04 18:04:22.113500 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-11d4b48b-e73c-4049-bce6-14ce63509dac tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Returning 409 to user: Cannot 'detach_volume' instance 16b81832-5021-4cd2-8ebf-767daeb17673 while it is in vm_state rescued {{(pid=123567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:04:22.114615 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-11d4b48b-e73c-4049-bce6-14ce63509dac tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "DELETE /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments/4ab2ee93-0ffb-4a5f-b48f-484c370dcd1d" status: 409 len: 152 microversion: 2.1 time: 0.139058 Feb 04 18:04:22.115178 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 227/464] 10.222.0.98 () {58 vars in 1415 bytes} [Fri Feb 4 18:04:21 2022] DELETE /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments/4ab2ee93-0ffb-4a5f-b48f-484c370dcd1d => generated 152 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 04 18:04:22.123119 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3f3b509e-6285-415f-82db-bd1294b8ecf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:04:22.123738 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-3f3b509e-6285-415f-82db-bd1294b8ecf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:22.130326 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3f3b509e-6285-415f-82db-bd1294b8ecf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:22.130801 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3f3b509e-6285-415f-82db-bd1294b8ecf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:22.131591 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3f3b509e-6285-415f-82db-bd1294b8ecf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:22.132033 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3f3b509e-6285-415f-82db-bd1294b8ecf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:22.189174 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-19d1df5d-b50e-4ba6-b9a7-9dbaef901931 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:22.199077 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-19d1df5d-b50e-4ba6-b9a7-9dbaef901931 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1319 microversion: 2.1 time: 0.171962 Feb 04 18:04:22.199674 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 238/465] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:22 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:22.203973 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-1b0addcd-7fd3-4051-ae4a-75a4c7a71491 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:22.204754 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-1b0addcd-7fd3-4051-ae4a-75a4c7a71491 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:22.215466 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1b0addcd-7fd3-4051-ae4a-75a4c7a71491 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:22.215466 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1b0addcd-7fd3-4051-ae4a-75a4c7a71491 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:22.215466 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1b0addcd-7fd3-4051-ae4a-75a4c7a71491 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:22.215466 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1b0addcd-7fd3-4051-ae4a-75a4c7a71491 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:22.329362 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-3f3b509e-6285-415f-82db-bd1294b8ecf3 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "POST /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/action" status: 202 len: 0 microversion: 2.1 time: 0.209498 Feb 04 18:04:22.333334 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 228/466] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Feb 4 18:04:22 2022] POST /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 04 18:04:22.338443 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-ec57d6e7-6180-4b18-9eea-723196653ddd tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:22.339161 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-ec57d6e7-6180-4b18-9eea-723196653ddd tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:22.345223 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ec57d6e7-6180-4b18-9eea-723196653ddd tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:22.345618 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ec57d6e7-6180-4b18-9eea-723196653ddd tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:22.346403 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ec57d6e7-6180-4b18-9eea-723196653ddd tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:22.346858 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ec57d6e7-6180-4b18-9eea-723196653ddd tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:22.357911 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-1b0addcd-7fd3-4051-ae4a-75a4c7a71491 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:22.365952 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-1b0addcd-7fd3-4051-ae4a-75a4c7a71491 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1509 microversion: 2.1 time: 0.165273 Feb 04 18:04:22.366556 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 239/467] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:22 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:22.493519 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ec57d6e7-6180-4b18-9eea-723196653ddd tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:22.501912 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-ec57d6e7-6180-4b18-9eea-723196653ddd tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1556 microversion: 2.1 time: 0.167386 Feb 04 18:04:22.502603 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 229/468] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:22 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:22.555018 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-57be16e3-de04-4aca-b613-26ad474a2218 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:22.555625 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-57be16e3-de04-4aca-b613-26ad474a2218 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:22.562489 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-57be16e3-de04-4aca-b613-26ad474a2218 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:22.562940 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-57be16e3-de04-4aca-b613-26ad474a2218 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:22.563724 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-57be16e3-de04-4aca-b613-26ad474a2218 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:22.564160 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-57be16e3-de04-4aca-b613-26ad474a2218 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:22.625362 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-57be16e3-de04-4aca-b613-26ad474a2218 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:22.632846 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-57be16e3-de04-4aca-b613-26ad474a2218 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1136 microversion: 2.1 time: 0.081454 Feb 04 18:04:22.633424 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 240/469] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:22 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1136 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:23.214932 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3a3d817e-cb1a-44c2-8ce7-e903f2657d56 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:23.215547 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-3a3d817e-cb1a-44c2-8ce7-e903f2657d56 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:23.222492 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3a3d817e-cb1a-44c2-8ce7-e903f2657d56 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:23.222944 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3a3d817e-cb1a-44c2-8ce7-e903f2657d56 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:23.224304 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3a3d817e-cb1a-44c2-8ce7-e903f2657d56 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:23.224304 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3a3d817e-cb1a-44c2-8ce7-e903f2657d56 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:23.362397 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-3a3d817e-cb1a-44c2-8ce7-e903f2657d56 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:23.370407 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-3a3d817e-cb1a-44c2-8ce7-e903f2657d56 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1319 microversion: 2.1 time: 0.159057 Feb 04 18:04:23.371076 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 230/470] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:23 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:23.519123 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-e5016715-24b5-4571-88fc-33b8a338ed4b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:23.519734 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-e5016715-24b5-4571-88fc-33b8a338ed4b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:23.526196 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e5016715-24b5-4571-88fc-33b8a338ed4b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:23.526612 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e5016715-24b5-4571-88fc-33b8a338ed4b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:23.527403 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e5016715-24b5-4571-88fc-33b8a338ed4b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:23.528045 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e5016715-24b5-4571-88fc-33b8a338ed4b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:23.649607 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c7d65020-5c08-4e01-8e15-580a0993c2b2 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:23.650334 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c7d65020-5c08-4e01-8e15-580a0993c2b2 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:23.662278 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c7d65020-5c08-4e01-8e15-580a0993c2b2 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:23.662278 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c7d65020-5c08-4e01-8e15-580a0993c2b2 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:23.662278 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c7d65020-5c08-4e01-8e15-580a0993c2b2 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:23.662278 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c7d65020-5c08-4e01-8e15-580a0993c2b2 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:23.687630 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-e5016715-24b5-4571-88fc-33b8a338ed4b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:23.696893 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-e5016715-24b5-4571-88fc-33b8a338ed4b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1556 microversion: 2.1 time: 0.181357 Feb 04 18:04:23.697550 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 241/471] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:23 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1556 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:23.723994 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c7d65020-5c08-4e01-8e15-580a0993c2b2 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:23.731240 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c7d65020-5c08-4e01-8e15-580a0993c2b2 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1184 microversion: 2.1 time: 0.085952 Feb 04 18:04:23.731820 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 231/472] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:23 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1184 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:24.391625 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-af04b378-9e39-41ef-b600-ec3317d3a785 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:24.392697 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-af04b378-9e39-41ef-b600-ec3317d3a785 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:24.399347 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-af04b378-9e39-41ef-b600-ec3317d3a785 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:24.400384 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-af04b378-9e39-41ef-b600-ec3317d3a785 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:24.400560 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-af04b378-9e39-41ef-b600-ec3317d3a785 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:24.404359 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-af04b378-9e39-41ef-b600-ec3317d3a785 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:24.547371 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-af04b378-9e39-41ef-b600-ec3317d3a785 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:24.555812 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-af04b378-9e39-41ef-b600-ec3317d3a785 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1507 microversion: 2.1 time: 0.171136 Feb 04 18:04:24.556409 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 242/473] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:24 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:24.713776 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-59fefb78-f3ec-488b-a363-2a3ea645b1ac tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:24.714677 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-59fefb78-f3ec-488b-a363-2a3ea645b1ac tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:24.726235 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-59fefb78-f3ec-488b-a363-2a3ea645b1ac tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:24.726235 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-59fefb78-f3ec-488b-a363-2a3ea645b1ac tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:24.726235 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-59fefb78-f3ec-488b-a363-2a3ea645b1ac tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:24.726235 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-59fefb78-f3ec-488b-a363-2a3ea645b1ac tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:24.749732 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ba8977f3-dca9-4a77-936c-dacd3b69a2e2 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:24.751286 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ba8977f3-dca9-4a77-936c-dacd3b69a2e2 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:24.759255 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ba8977f3-dca9-4a77-936c-dacd3b69a2e2 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:24.759974 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ba8977f3-dca9-4a77-936c-dacd3b69a2e2 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:24.762794 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ba8977f3-dca9-4a77-936c-dacd3b69a2e2 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:24.763310 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ba8977f3-dca9-4a77-936c-dacd3b69a2e2 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:24.850609 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-ba8977f3-dca9-4a77-936c-dacd3b69a2e2 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:24.861059 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ba8977f3-dca9-4a77-936c-dacd3b69a2e2 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1202 microversion: 2.1 time: 0.115707 Feb 04 18:04:24.861965 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 243/474] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:24 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1202 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:24.918158 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-59fefb78-f3ec-488b-a363-2a3ea645b1ac tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:24.926949 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-59fefb78-f3ec-488b-a363-2a3ea645b1ac tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1556 microversion: 2.1 time: 0.217442 Feb 04 18:04:24.927457 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 232/475] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:24 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1556 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:25.420458 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ab3c7d55-0f55-41f7-9ffc-e3d8dc81a14f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "210b3a6a-8715-4e03-bfaf-f9ca86ccd559"}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:04:25.422387 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ab3c7d55-0f55-41f7-9ffc-e3d8dc81a14f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:25.429009 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ab3c7d55-0f55-41f7-9ffc-e3d8dc81a14f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:25.429459 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ab3c7d55-0f55-41f7-9ffc-e3d8dc81a14f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:25.430457 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ab3c7d55-0f55-41f7-9ffc-e3d8dc81a14f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:25.431065 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ab3c7d55-0f55-41f7-9ffc-e3d8dc81a14f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:25.879242 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-863c275b-9505-4a24-b4de-2ec379426fdb tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:25.879832 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-863c275b-9505-4a24-b4de-2ec379426fdb tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:25.887807 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-863c275b-9505-4a24-b4de-2ec379426fdb tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:25.888257 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-863c275b-9505-4a24-b4de-2ec379426fdb tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:25.889027 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-863c275b-9505-4a24-b4de-2ec379426fdb tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:25.890007 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-863c275b-9505-4a24-b4de-2ec379426fdb tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:26.057002 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-863c275b-9505-4a24-b4de-2ec379426fdb tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:26.066007 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-863c275b-9505-4a24-b4de-2ec379426fdb tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1270 microversion: 2.1 time: 0.190374 Feb 04 18:04:26.066804 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 233/476] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:25 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1270 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:26.071548 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c67b381d-e077-4c4b-a265-3ab07439bfdb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:26.072409 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c67b381d-e077-4c4b-a265-3ab07439bfdb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:26.081773 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c67b381d-e077-4c4b-a265-3ab07439bfdb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:26.082546 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c67b381d-e077-4c4b-a265-3ab07439bfdb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:26.083573 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c67b381d-e077-4c4b-a265-3ab07439bfdb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:26.084022 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c67b381d-e077-4c4b-a265-3ab07439bfdb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:26.226035 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c67b381d-e077-4c4b-a265-3ab07439bfdb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:26.236679 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c67b381d-e077-4c4b-a265-3ab07439bfdb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1556 microversion: 2.1 time: 0.168628 Feb 04 18:04:26.237359 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 234/477] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:26 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1556 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:26.274289 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-9982cd68-8b74-409f-8fc0-ec500df66d67 req-7cfd76ca-c449-4459-b003-a7108b8916a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78c4e346-86a3-4ecf-b0a8-5de2dced1ef1", "tag": "a8ca804a-2879-4f45-91f3-f7ace366691d"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:04:26.276199 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:04:26.276199 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:04:26.284292 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-9982cd68-8b74-409f-8fc0-ec500df66d67 req-7cfd76ca-c449-4459-b003-a7108b8916a9 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:26.284923 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-9982cd68-8b74-409f-8fc0-ec500df66d67 req-7cfd76ca-c449-4459-b003-a7108b8916a9 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:26.298953 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-9982cd68-8b74-409f-8fc0-ec500df66d67 req-7cfd76ca-c449-4459-b003-a7108b8916a9 service nova] Creating event network-changed:a8ca804a-2879-4f45-91f3-f7ace366691d for instance 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 on hv-cinder-82276 Feb 04 18:04:26.304576 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-9982cd68-8b74-409f-8fc0-ec500df66d67 req-7cfd76ca-c449-4459-b003-a7108b8916a9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033890 Feb 04 18:04:26.305660 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 235/478] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:04:27.084524 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b0688a47-47bf-4c93-9b70-fa36844f036c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:27.085272 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-b0688a47-47bf-4c93-9b70-fa36844f036c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:27.091416 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b0688a47-47bf-4c93-9b70-fa36844f036c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:27.091867 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b0688a47-47bf-4c93-9b70-fa36844f036c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:27.093307 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b0688a47-47bf-4c93-9b70-fa36844f036c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:27.093747 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b0688a47-47bf-4c93-9b70-fa36844f036c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:27.229188 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-b0688a47-47bf-4c93-9b70-fa36844f036c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:27.236683 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b0688a47-47bf-4c93-9b70-fa36844f036c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1270 microversion: 2.1 time: 0.156555 Feb 04 18:04:27.237266 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 236/479] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:27 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:27.253802 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-0beb43b9-0b7a-4207-973f-88781638fc66 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:27.254410 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-0beb43b9-0b7a-4207-973f-88781638fc66 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:27.261198 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0beb43b9-0b7a-4207-973f-88781638fc66 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:27.261648 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0beb43b9-0b7a-4207-973f-88781638fc66 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:27.262446 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0beb43b9-0b7a-4207-973f-88781638fc66 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:27.262898 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0beb43b9-0b7a-4207-973f-88781638fc66 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:27.408751 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-0beb43b9-0b7a-4207-973f-88781638fc66 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:27.416690 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-0beb43b9-0b7a-4207-973f-88781638fc66 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1556 microversion: 2.1 time: 0.166433 Feb 04 18:04:27.417268 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 237/480] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:27 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:28.252943 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-0f7e1e69-7490-4cba-9280-117610ef5178 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:28.253622 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-0f7e1e69-7490-4cba-9280-117610ef5178 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:28.259893 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0f7e1e69-7490-4cba-9280-117610ef5178 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:28.263453 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0f7e1e69-7490-4cba-9280-117610ef5178 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:28.263453 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0f7e1e69-7490-4cba-9280-117610ef5178 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:28.263453 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0f7e1e69-7490-4cba-9280-117610ef5178 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:28.400619 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-0f7e1e69-7490-4cba-9280-117610ef5178 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:28.409674 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-0f7e1e69-7490-4cba-9280-117610ef5178 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1270 microversion: 2.1 time: 0.160344 Feb 04 18:04:28.410263 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 238/481] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:28 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:28.433009 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-31d83133-2ffd-43de-b342-9a153b989f7c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:28.433650 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-31d83133-2ffd-43de-b342-9a153b989f7c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:28.439932 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-31d83133-2ffd-43de-b342-9a153b989f7c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:28.440394 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-31d83133-2ffd-43de-b342-9a153b989f7c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:28.441197 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-31d83133-2ffd-43de-b342-9a153b989f7c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:28.441640 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-31d83133-2ffd-43de-b342-9a153b989f7c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:28.589987 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-31d83133-2ffd-43de-b342-9a153b989f7c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:28.598803 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-31d83133-2ffd-43de-b342-9a153b989f7c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1556 microversion: 2.1 time: 0.169468 Feb 04 18:04:28.599389 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 239/482] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:28 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:29.426638 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-5bab1e9a-5cf7-46d1-bf78-7053eb13877a tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:29.427269 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-5bab1e9a-5cf7-46d1-bf78-7053eb13877a tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:29.433652 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5bab1e9a-5cf7-46d1-bf78-7053eb13877a tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:29.434095 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5bab1e9a-5cf7-46d1-bf78-7053eb13877a tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:29.435051 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5bab1e9a-5cf7-46d1-bf78-7053eb13877a tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:29.435496 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5bab1e9a-5cf7-46d1-bf78-7053eb13877a tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:29.587000 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5bab1e9a-5cf7-46d1-bf78-7053eb13877a tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:29.599818 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-5bab1e9a-5cf7-46d1-bf78-7053eb13877a tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1270 microversion: 2.1 time: 0.176848 Feb 04 18:04:29.600425 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 240/483] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:29 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1270 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:29.625996 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-f9faf285-42d4-4ad9-a757-daf6d50bd111 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:29.626748 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-f9faf285-42d4-4ad9-a757-daf6d50bd111 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:29.634133 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f9faf285-42d4-4ad9-a757-daf6d50bd111 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:29.634701 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f9faf285-42d4-4ad9-a757-daf6d50bd111 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:29.635559 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f9faf285-42d4-4ad9-a757-daf6d50bd111 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:29.636042 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f9faf285-42d4-4ad9-a757-daf6d50bd111 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:29.787006 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-f9faf285-42d4-4ad9-a757-daf6d50bd111 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:29.808581 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-f9faf285-42d4-4ad9-a757-daf6d50bd111 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1556 microversion: 2.1 time: 0.195360 Feb 04 18:04:29.809182 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 241/484] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:29 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1556 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:30.067408 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ab3c7d55-0f55-41f7-9ffc-e3d8dc81a14f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "POST /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.650613 Feb 04 18:04:30.068436 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 244/485] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Feb 4 18:04:25 2022] POST /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c/os-volume_attachments => generated 194 bytes in 4652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:04:30.616907 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-2a625723-e2c0-4ca0-b16f-bcc7de531ee4 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:30.617550 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-2a625723-e2c0-4ca0-b16f-bcc7de531ee4 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:30.629153 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2a625723-e2c0-4ca0-b16f-bcc7de531ee4 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:30.629901 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2a625723-e2c0-4ca0-b16f-bcc7de531ee4 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:30.630942 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2a625723-e2c0-4ca0-b16f-bcc7de531ee4 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:30.631643 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2a625723-e2c0-4ca0-b16f-bcc7de531ee4 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:30.782211 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-2a625723-e2c0-4ca0-b16f-bcc7de531ee4 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:30.789616 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-2a625723-e2c0-4ca0-b16f-bcc7de531ee4 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1270 microversion: 2.1 time: 0.176693 Feb 04 18:04:30.790186 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 242/486] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:30 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1270 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:30.827388 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-9db8e6c0-998f-44c3-9385-1dad4bc66b0f tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:30.828231 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-9db8e6c0-998f-44c3-9385-1dad4bc66b0f tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:30.835621 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9db8e6c0-998f-44c3-9385-1dad4bc66b0f tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:30.836284 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9db8e6c0-998f-44c3-9385-1dad4bc66b0f tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:30.837122 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9db8e6c0-998f-44c3-9385-1dad4bc66b0f tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:30.837568 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9db8e6c0-998f-44c3-9385-1dad4bc66b0f tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:30.980749 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-9db8e6c0-998f-44c3-9385-1dad4bc66b0f tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:30.990594 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-9db8e6c0-998f-44c3-9385-1dad4bc66b0f tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1556 microversion: 2.1 time: 0.167799 Feb 04 18:04:30.991215 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 245/487] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:30 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:31.807683 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-80c51306-6061-4567-9e10-73c1736e1e5b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:31.808296 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-80c51306-6061-4567-9e10-73c1736e1e5b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:31.814633 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-80c51306-6061-4567-9e10-73c1736e1e5b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:31.815091 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-80c51306-6061-4567-9e10-73c1736e1e5b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:31.815876 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-80c51306-6061-4567-9e10-73c1736e1e5b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:31.816325 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-80c51306-6061-4567-9e10-73c1736e1e5b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:31.959351 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-80c51306-6061-4567-9e10-73c1736e1e5b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:31.966760 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-80c51306-6061-4567-9e10-73c1736e1e5b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1258 microversion: 2.1 time: 0.162686 Feb 04 18:04:31.967328 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 243/488] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:31 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:32.008352 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b81bab43-dea0-4736-8c0b-4fb7d3f180d1 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:32.013873 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-b81bab43-dea0-4736-8c0b-4fb7d3f180d1 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:32.015899 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b81bab43-dea0-4736-8c0b-4fb7d3f180d1 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:32.016371 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b81bab43-dea0-4736-8c0b-4fb7d3f180d1 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:32.017140 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b81bab43-dea0-4736-8c0b-4fb7d3f180d1 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:32.017578 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b81bab43-dea0-4736-8c0b-4fb7d3f180d1 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:32.158211 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-b81bab43-dea0-4736-8c0b-4fb7d3f180d1 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:32.166437 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-b81bab43-dea0-4736-8c0b-4fb7d3f180d1 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1556 microversion: 2.1 time: 0.161663 Feb 04 18:04:32.167035 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 246/489] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:32 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:32.984291 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-8fd88352-14a0-46d9-bd30-dd3521a7b5f8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:32.984899 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-8fd88352-14a0-46d9-bd30-dd3521a7b5f8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:32.991477 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8fd88352-14a0-46d9-bd30-dd3521a7b5f8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:32.991924 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8fd88352-14a0-46d9-bd30-dd3521a7b5f8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:32.992699 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8fd88352-14a0-46d9-bd30-dd3521a7b5f8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:32.993144 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8fd88352-14a0-46d9-bd30-dd3521a7b5f8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:33.134717 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-8fd88352-14a0-46d9-bd30-dd3521a7b5f8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:33.142829 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-8fd88352-14a0-46d9-bd30-dd3521a7b5f8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1258 microversion: 2.1 time: 0.162130 Feb 04 18:04:33.146867 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 244/490] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:32 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:33.184991 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-8a17fd88-cae9-49dd-96b8-185f5b39be1f tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:33.188377 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-8a17fd88-cae9-49dd-96b8-185f5b39be1f tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:33.193271 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8a17fd88-cae9-49dd-96b8-185f5b39be1f tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:33.193769 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8a17fd88-cae9-49dd-96b8-185f5b39be1f tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:33.194563 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8a17fd88-cae9-49dd-96b8-185f5b39be1f tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:33.195009 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8a17fd88-cae9-49dd-96b8-185f5b39be1f tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:33.339441 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-8a17fd88-cae9-49dd-96b8-185f5b39be1f tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:33.347761 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-8a17fd88-cae9-49dd-96b8-185f5b39be1f tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1562 microversion: 2.1 time: 0.166507 Feb 04 18:04:33.348343 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 247/491] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:33 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:33.415809 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b7d40b9e-35be-4fb7-bc83-6d98063da188 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:33.416306 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-b7d40b9e-35be-4fb7-bc83-6d98063da188 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:33.422787 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b7d40b9e-35be-4fb7-bc83-6d98063da188 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:33.423214 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b7d40b9e-35be-4fb7-bc83-6d98063da188 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:33.424002 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b7d40b9e-35be-4fb7-bc83-6d98063da188 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:33.424437 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b7d40b9e-35be-4fb7-bc83-6d98063da188 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:33.505137 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.objects.instance [None req-b7d40b9e-35be-4fb7-bc83-6d98063da188 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lazy-loading 'services' on Instance uuid 16b81832-5021-4cd2-8ebf-767daeb17673 {{(pid=123567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:04:33.774713 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b7d40b9e-35be-4fb7-bc83-6d98063da188 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "DELETE /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments/4ab2ee93-0ffb-4a5f-b48f-484c370dcd1d" status: 202 len: 0 microversion: 2.1 time: 0.362232 Feb 04 18:04:33.775602 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 245/492] 10.222.0.98 () {58 vars in 1415 bytes} [Fri Feb 4 18:04:33 2022] DELETE /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments/4ab2ee93-0ffb-4a5f-b48f-484c370dcd1d => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 04 18:04:33.784687 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-388feddd-8bfd-42b6-88b6-02c78396ab99 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:33.786094 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-388feddd-8bfd-42b6-88b6-02c78396ab99 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:33.792730 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-388feddd-8bfd-42b6-88b6-02c78396ab99 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:33.793421 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-388feddd-8bfd-42b6-88b6-02c78396ab99 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:33.794335 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-388feddd-8bfd-42b6-88b6-02c78396ab99 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:33.794964 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-388feddd-8bfd-42b6-88b6-02c78396ab99 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:33.826625 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-388feddd-8bfd-42b6-88b6-02c78396ab99 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046459 Feb 04 18:04:33.827824 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 248/493] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:04:33 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:04:34.159559 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-4b635213-ac30-4622-b580-5d09324c3eb5 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:34.160322 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-4b635213-ac30-4622-b580-5d09324c3eb5 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:34.166553 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4b635213-ac30-4622-b580-5d09324c3eb5 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:34.167010 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4b635213-ac30-4622-b580-5d09324c3eb5 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:34.167818 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4b635213-ac30-4622-b580-5d09324c3eb5 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:34.168253 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4b635213-ac30-4622-b580-5d09324c3eb5 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:34.302687 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-4b635213-ac30-4622-b580-5d09324c3eb5 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:34.309958 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-4b635213-ac30-4622-b580-5d09324c3eb5 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1258 microversion: 2.1 time: 0.154989 Feb 04 18:04:34.310775 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 246/494] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:34 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:34.839235 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b0e6f989-f88d-4899-92ea-2ef90be4b83d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:34.840154 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-b0e6f989-f88d-4899-92ea-2ef90be4b83d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:34.847194 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b0e6f989-f88d-4899-92ea-2ef90be4b83d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:34.847659 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b0e6f989-f88d-4899-92ea-2ef90be4b83d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:34.848460 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b0e6f989-f88d-4899-92ea-2ef90be4b83d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:34.848894 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b0e6f989-f88d-4899-92ea-2ef90be4b83d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:34.880293 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-b0e6f989-f88d-4899-92ea-2ef90be4b83d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044917 Feb 04 18:04:34.880882 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 249/495] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:04:34 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:04:35.326675 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-037a4872-89c3-4d2f-8911-4dd8140dca9b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:35.327900 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-037a4872-89c3-4d2f-8911-4dd8140dca9b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:35.334191 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-037a4872-89c3-4d2f-8911-4dd8140dca9b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:35.334670 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-037a4872-89c3-4d2f-8911-4dd8140dca9b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:35.335455 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-037a4872-89c3-4d2f-8911-4dd8140dca9b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:35.335895 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-037a4872-89c3-4d2f-8911-4dd8140dca9b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:35.477255 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-037a4872-89c3-4d2f-8911-4dd8140dca9b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:35.484636 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-037a4872-89c3-4d2f-8911-4dd8140dca9b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1258 microversion: 2.1 time: 0.161578 Feb 04 18:04:35.485202 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 247/496] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:35 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:35.895286 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-2a79dd1a-52b8-4d57-bfe3-b68c846c4f16 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:35.896504 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-2a79dd1a-52b8-4d57-bfe3-b68c846c4f16 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:35.902862 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2a79dd1a-52b8-4d57-bfe3-b68c846c4f16 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:35.903394 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2a79dd1a-52b8-4d57-bfe3-b68c846c4f16 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:35.904266 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2a79dd1a-52b8-4d57-bfe3-b68c846c4f16 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:35.904778 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2a79dd1a-52b8-4d57-bfe3-b68c846c4f16 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:35.934053 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-2a79dd1a-52b8-4d57-bfe3-b68c846c4f16 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042770 Feb 04 18:04:35.940110 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 250/497] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:04:35 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:04:36.501912 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-29e85ae7-97ec-4bd9-9a9a-d0e4cf360dfc tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:36.502551 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-29e85ae7-97ec-4bd9-9a9a-d0e4cf360dfc tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:36.508755 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-29e85ae7-97ec-4bd9-9a9a-d0e4cf360dfc tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:36.509208 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-29e85ae7-97ec-4bd9-9a9a-d0e4cf360dfc tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:36.509983 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-29e85ae7-97ec-4bd9-9a9a-d0e4cf360dfc tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:36.510437 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-29e85ae7-97ec-4bd9-9a9a-d0e4cf360dfc tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:36.647239 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-29e85ae7-97ec-4bd9-9a9a-d0e4cf360dfc tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:36.654718 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-29e85ae7-97ec-4bd9-9a9a-d0e4cf360dfc tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1258 microversion: 2.1 time: 0.156790 Feb 04 18:04:36.655273 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 248/498] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:36 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:36.952075 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-007725df-5846-4a63-ba9b-aadc5081a4d0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:36.952906 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-007725df-5846-4a63-ba9b-aadc5081a4d0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:36.959234 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-007725df-5846-4a63-ba9b-aadc5081a4d0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:36.959695 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-007725df-5846-4a63-ba9b-aadc5081a4d0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:36.960484 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-007725df-5846-4a63-ba9b-aadc5081a4d0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:36.960922 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-007725df-5846-4a63-ba9b-aadc5081a4d0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:36.993552 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-007725df-5846-4a63-ba9b-aadc5081a4d0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045045 Feb 04 18:04:36.994477 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 251/499] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:04:36 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:04:37.671421 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-250eadc2-6ca0-47e3-80de-c84733b9adea tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:37.672028 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-250eadc2-6ca0-47e3-80de-c84733b9adea tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:37.678682 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-250eadc2-6ca0-47e3-80de-c84733b9adea tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:37.681156 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-250eadc2-6ca0-47e3-80de-c84733b9adea tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:37.681156 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-250eadc2-6ca0-47e3-80de-c84733b9adea tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:37.681156 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-250eadc2-6ca0-47e3-80de-c84733b9adea tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:37.821668 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-250eadc2-6ca0-47e3-80de-c84733b9adea tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:37.831769 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-250eadc2-6ca0-47e3-80de-c84733b9adea tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1258 microversion: 2.1 time: 0.162640 Feb 04 18:04:37.831769 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 249/500] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:37 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:38.007752 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-065482bb-5c2b-4624-b966-7f86949a0ef5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:38.008729 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-065482bb-5c2b-4624-b966-7f86949a0ef5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:38.015972 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-065482bb-5c2b-4624-b966-7f86949a0ef5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:38.016447 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-065482bb-5c2b-4624-b966-7f86949a0ef5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:38.020606 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-065482bb-5c2b-4624-b966-7f86949a0ef5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:38.020606 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-065482bb-5c2b-4624-b966-7f86949a0ef5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:38.048232 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-065482bb-5c2b-4624-b966-7f86949a0ef5 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044235 Feb 04 18:04:38.048830 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 252/501] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:04:38 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:04:38.847867 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-4cc62d5a-3a94-4393-8c6f-59de03cdd612 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:38.848493 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-4cc62d5a-3a94-4393-8c6f-59de03cdd612 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:38.854909 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4cc62d5a-3a94-4393-8c6f-59de03cdd612 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:38.855358 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4cc62d5a-3a94-4393-8c6f-59de03cdd612 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:38.856158 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4cc62d5a-3a94-4393-8c6f-59de03cdd612 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:38.856580 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4cc62d5a-3a94-4393-8c6f-59de03cdd612 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:38.995019 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-4cc62d5a-3a94-4393-8c6f-59de03cdd612 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:39.002888 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-4cc62d5a-3a94-4393-8c6f-59de03cdd612 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1258 microversion: 2.1 time: 0.158487 Feb 04 18:04:39.003582 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 250/502] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:38 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:39.060084 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-effa655e-edc4-4a1c-a7c4-41dbedd0dc3d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:39.060995 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-effa655e-edc4-4a1c-a7c4-41dbedd0dc3d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:39.067767 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-effa655e-edc4-4a1c-a7c4-41dbedd0dc3d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:39.068214 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-effa655e-edc4-4a1c-a7c4-41dbedd0dc3d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:39.069009 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-effa655e-edc4-4a1c-a7c4-41dbedd0dc3d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:39.069446 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-effa655e-edc4-4a1c-a7c4-41dbedd0dc3d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:39.100436 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-effa655e-edc4-4a1c-a7c4-41dbedd0dc3d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044000 Feb 04 18:04:39.101013 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 253/503] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:04:39 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:04:40.019625 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-51116e1a-b9d0-4f93-a080-08b1e4d489e6 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:40.020253 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-51116e1a-b9d0-4f93-a080-08b1e4d489e6 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:40.026928 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-51116e1a-b9d0-4f93-a080-08b1e4d489e6 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:40.027398 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-51116e1a-b9d0-4f93-a080-08b1e4d489e6 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:40.028195 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-51116e1a-b9d0-4f93-a080-08b1e4d489e6 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:40.028923 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-51116e1a-b9d0-4f93-a080-08b1e4d489e6 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:40.112574 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-1c30d1ed-27bf-4cc3-b761-11acb37ef101 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:40.113640 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-1c30d1ed-27bf-4cc3-b761-11acb37ef101 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:40.122666 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1c30d1ed-27bf-4cc3-b761-11acb37ef101 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:40.123486 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1c30d1ed-27bf-4cc3-b761-11acb37ef101 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:40.124475 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1c30d1ed-27bf-4cc3-b761-11acb37ef101 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:40.124925 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1c30d1ed-27bf-4cc3-b761-11acb37ef101 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:40.160514 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-1c30d1ed-27bf-4cc3-b761-11acb37ef101 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052135 Feb 04 18:04:40.161098 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 254/504] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:04:40 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:04:40.180932 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-51116e1a-b9d0-4f93-a080-08b1e4d489e6 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:40.189526 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-51116e1a-b9d0-4f93-a080-08b1e4d489e6 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1258 microversion: 2.1 time: 0.173477 Feb 04 18:04:40.190195 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 251/505] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:40 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:40.849624 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-d6b321fe-1f5f-484f-95d5-44031062e8b2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:40.850129 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-d6b321fe-1f5f-484f-95d5-44031062e8b2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:40.856191 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d6b321fe-1f5f-484f-95d5-44031062e8b2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:40.856710 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d6b321fe-1f5f-484f-95d5-44031062e8b2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:40.857562 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d6b321fe-1f5f-484f-95d5-44031062e8b2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:40.858918 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d6b321fe-1f5f-484f-95d5-44031062e8b2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:40.954604 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.objects.instance [None req-d6b321fe-1f5f-484f-95d5-44031062e8b2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lazy-loading 'services' on Instance uuid c35f5dd4-8689-4c1f-b63d-3562678b8e1c {{(pid=123566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:04:41.164374 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-d6b321fe-1f5f-484f-95d5-44031062e8b2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "DELETE /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c/os-volume_attachments/210b3a6a-8715-4e03-bfaf-f9ca86ccd559" status: 202 len: 0 microversion: 2.1 time: 0.318299 Feb 04 18:04:41.166127 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 255/506] 10.222.0.98 () {58 vars in 1415 bytes} [Fri Feb 4 18:04:40 2022] DELETE /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c/os-volume_attachments/210b3a6a-8715-4e03-bfaf-f9ca86ccd559 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 04 18:04:41.171799 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-18d5dd8d-ff3b-411f-a879-bbc31f2d0af7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:41.172826 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-18d5dd8d-ff3b-411f-a879-bbc31f2d0af7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:41.173577 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-0261bac1-d80b-408f-9578-59baebbd78bc tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:41.174804 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-0261bac1-d80b-408f-9578-59baebbd78bc tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:41.181097 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0261bac1-d80b-408f-9578-59baebbd78bc tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:41.181556 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0261bac1-d80b-408f-9578-59baebbd78bc tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:41.182347 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0261bac1-d80b-408f-9578-59baebbd78bc tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:41.182886 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0261bac1-d80b-408f-9578-59baebbd78bc tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:41.191290 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-18d5dd8d-ff3b-411f-a879-bbc31f2d0af7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:41.194546 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-18d5dd8d-ff3b-411f-a879-bbc31f2d0af7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:41.194546 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-18d5dd8d-ff3b-411f-a879-bbc31f2d0af7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:41.194546 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-18d5dd8d-ff3b-411f-a879-bbc31f2d0af7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:41.220276 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-0261bac1-d80b-408f-9578-59baebbd78bc tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050701 Feb 04 18:04:41.220864 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 256/507] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:04:41 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:04:41.225513 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-632a2603-aa8b-4601-a849-a4954064596f tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:41.226127 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-632a2603-aa8b-4601-a849-a4954064596f tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:41.231319 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-18d5dd8d-ff3b-411f-a879-bbc31f2d0af7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063264 Feb 04 18:04:41.232093 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 252/508] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:04:41 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:04:41.232210 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-632a2603-aa8b-4601-a849-a4954064596f tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:41.232404 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-632a2603-aa8b-4601-a849-a4954064596f tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:41.233716 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-632a2603-aa8b-4601-a849-a4954064596f tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:41.234157 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-632a2603-aa8b-4601-a849-a4954064596f tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:41.381472 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-632a2603-aa8b-4601-a849-a4954064596f tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:41.388967 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-632a2603-aa8b-4601-a849-a4954064596f tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1258 microversion: 2.1 time: 0.166981 Feb 04 18:04:41.390278 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 257/509] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:41 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:42.232025 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a1f7d878-cd74-4927-a590-98e7e4a17572 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:42.232848 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-a1f7d878-cd74-4927-a590-98e7e4a17572 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:42.239092 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a1f7d878-cd74-4927-a590-98e7e4a17572 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:42.239543 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a1f7d878-cd74-4927-a590-98e7e4a17572 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:42.240721 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a1f7d878-cd74-4927-a590-98e7e4a17572 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:42.241162 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a1f7d878-cd74-4927-a590-98e7e4a17572 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:42.243523 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-095bb7a3-cdf3-428c-bb67-ddb496521eba tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:42.244463 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-095bb7a3-cdf3-428c-bb67-ddb496521eba tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:42.250852 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-095bb7a3-cdf3-428c-bb67-ddb496521eba tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:42.251300 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-095bb7a3-cdf3-428c-bb67-ddb496521eba tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:42.252079 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-095bb7a3-cdf3-428c-bb67-ddb496521eba tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:42.252508 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-095bb7a3-cdf3-428c-bb67-ddb496521eba tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:42.272814 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a1f7d878-cd74-4927-a590-98e7e4a17572 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044531 Feb 04 18:04:42.273385 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 253/510] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:04:42 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:04:42.282658 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-095bb7a3-cdf3-428c-bb67-ddb496521eba tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043016 Feb 04 18:04:42.283214 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 258/511] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:04:42 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:04:42.406329 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-85f90bde-d6cb-4e01-9937-2d6d4a49ddad tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:42.406972 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-85f90bde-d6cb-4e01-9937-2d6d4a49ddad tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:42.412904 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-85f90bde-d6cb-4e01-9937-2d6d4a49ddad tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:42.413348 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-85f90bde-d6cb-4e01-9937-2d6d4a49ddad tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:42.414125 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-85f90bde-d6cb-4e01-9937-2d6d4a49ddad tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:42.414581 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-85f90bde-d6cb-4e01-9937-2d6d4a49ddad tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:42.551545 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-85f90bde-d6cb-4e01-9937-2d6d4a49ddad tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:42.558784 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-85f90bde-d6cb-4e01-9937-2d6d4a49ddad tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1258 microversion: 2.1 time: 0.156079 Feb 04 18:04:42.559350 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 254/512] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:42 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:43.285028 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-8c8435d7-519c-4c37-874b-dc32c5248271 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:43.285979 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-8c8435d7-519c-4c37-874b-dc32c5248271 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:43.292480 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8c8435d7-519c-4c37-874b-dc32c5248271 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:43.292933 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8c8435d7-519c-4c37-874b-dc32c5248271 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:43.293083 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-7191ab51-ea2d-423b-b869-34e7a252ace0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:43.293716 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8c8435d7-519c-4c37-874b-dc32c5248271 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:43.293990 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-7191ab51-ea2d-423b-b869-34e7a252ace0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:43.294155 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8c8435d7-519c-4c37-874b-dc32c5248271 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:43.300860 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7191ab51-ea2d-423b-b869-34e7a252ace0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:43.301307 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7191ab51-ea2d-423b-b869-34e7a252ace0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:43.302082 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7191ab51-ea2d-423b-b869-34e7a252ace0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:43.302536 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7191ab51-ea2d-423b-b869-34e7a252ace0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:43.323527 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-8c8435d7-519c-4c37-874b-dc32c5248271 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042283 Feb 04 18:04:43.324101 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 259/513] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:04:43 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:04:43.330757 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-7191ab51-ea2d-423b-b869-34e7a252ace0 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041347 Feb 04 18:04:43.331314 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 255/514] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:04:43 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 04 18:04:43.575652 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-cee217ca-3c94-4ddf-b7cb-782533362f1f tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:43.576256 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-cee217ca-3c94-4ddf-b7cb-782533362f1f tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:43.582998 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cee217ca-3c94-4ddf-b7cb-782533362f1f tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:43.583463 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cee217ca-3c94-4ddf-b7cb-782533362f1f tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:43.584396 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cee217ca-3c94-4ddf-b7cb-782533362f1f tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:43.584790 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cee217ca-3c94-4ddf-b7cb-782533362f1f tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:43.727418 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-cee217ca-3c94-4ddf-b7cb-782533362f1f tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:43.735711 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-cee217ca-3c94-4ddf-b7cb-782533362f1f tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1258 microversion: 2.1 time: 0.163662 Feb 04 18:04:43.736448 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 260/515] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:43 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:43.862093 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-28863ad2-e795-41af-92f9-0a268e88a16c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-230526376", "imageRef": "b0fb57f5-967d-4692-94f3-accee37910c3", "flavorRef": "452", "networks": [{"uuid": "3c8f4dc8-6fb2-4000-b5a7-88685daca3d0"}]}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:04:43.911627 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.network.neutron [None req-28863ad2-e795-41af-92f9-0a268e88a16c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] validate_networks() for [('3c8f4dc8-6fb2-4000-b5a7-88685daca3d0', None, None, None, None, None)] {{(pid=123567) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 04 18:04:44.258817 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-28863ad2-e795-41af-92f9-0a268e88a16c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Flavor limits 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 04 18:04:44.259257 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-28863ad2-e795-41af-92f9-0a268e88a16c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Image limits 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 04 18:04:44.259846 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-28863ad2-e795-41af-92f9-0a268e88a16c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Flavor pref 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 04 18:04:44.260265 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-28863ad2-e795-41af-92f9-0a268e88a16c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Image pref 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 04 18:04:44.260682 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-28863ad2-e795-41af-92f9-0a268e88a16c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 04 18:04:44.269535 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-28863ad2-e795-41af-92f9-0a268e88a16c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:44.269988 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-28863ad2-e795-41af-92f9-0a268e88a16c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:44.270849 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-28863ad2-e795-41af-92f9-0a268e88a16c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:44.271298 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-28863ad2-e795-41af-92f9-0a268e88a16c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:44.288923 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-28863ad2-e795-41af-92f9-0a268e88a16c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Getting quotas for project d702ff83402e4a79b37f95a3fc6775a3. Resources: {'cores', 'ram', 'instances'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:04:44.292860 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-28863ad2-e795-41af-92f9-0a268e88a16c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Getting quotas for user 6414e43a723f47eea81f71706d1a8cdd and project d702ff83402e4a79b37f95a3fc6775a3. Resources: {'cores', 'ram', 'instances'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:04:44.304701 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-28863ad2-e795-41af-92f9-0a268e88a16c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Going to run 1 instances... {{(pid=123567) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 04 18:04:44.307058 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-28863ad2-e795-41af-92f9-0a268e88a16c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 680d8d06-f576-446b-b2de-326524afc5fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0fb57f5-967d-4692-94f3-accee37910c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 04 18:04:44.334775 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-bcd8bb91-4a93-4984-906c-fb5d326e4107 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:44.335811 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-bcd8bb91-4a93-4984-906c-fb5d326e4107 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:44.342235 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bcd8bb91-4a93-4984-906c-fb5d326e4107 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:44.342788 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bcd8bb91-4a93-4984-906c-fb5d326e4107 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:44.343629 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bcd8bb91-4a93-4984-906c-fb5d326e4107 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:44.344064 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bcd8bb91-4a93-4984-906c-fb5d326e4107 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:44.375824 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-bcd8bb91-4a93-4984-906c-fb5d326e4107 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044947 Feb 04 18:04:44.376396 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 261/516] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:04:44 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 04 18:04:44.442362 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-28863ad2-e795-41af-92f9-0a268e88a16c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.584579 Feb 04 18:04:44.443714 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 256/517] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Feb 4 18:04:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 04 18:04:44.453241 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-f75582ff-e7f5-432b-aa94-f6a3f541628c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:44.454276 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-f75582ff-e7f5-432b-aa94-f6a3f541628c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 680d8d06-f576-446b-b2de-326524afc5fb] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:44.511972 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-f75582ff-e7f5-432b-aa94-f6a3f541628c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:44.519485 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-f75582ff-e7f5-432b-aa94-f6a3f541628c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb" status: 200 len: 1213 microversion: 2.1 time: 0.069904 Feb 04 18:04:44.520079 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 262/518] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:44 2022] GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:44.753050 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-8d9806e3-3a68-4a6e-a0f4-58a8c7f95181 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:44.753662 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-8d9806e3-3a68-4a6e-a0f4-58a8c7f95181 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:44.760961 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8d9806e3-3a68-4a6e-a0f4-58a8c7f95181 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:44.761481 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8d9806e3-3a68-4a6e-a0f4-58a8c7f95181 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:44.762284 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8d9806e3-3a68-4a6e-a0f4-58a8c7f95181 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:44.762795 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8d9806e3-3a68-4a6e-a0f4-58a8c7f95181 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:44.918134 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-8d9806e3-3a68-4a6e-a0f4-58a8c7f95181 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:44.926204 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-8d9806e3-3a68-4a6e-a0f4-58a8c7f95181 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1258 microversion: 2.1 time: 0.176874 Feb 04 18:04:44.926808 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 257/519] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:44 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1258 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:45.188619 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-b7ae126b-0bbb-40f3-b7cd-0616b1c09624 req-3234d156-c5f6-4da5-b15a-7ccbd0a94052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c4e346-86a3-4ecf-b0a8-5de2dced1ef1", "name": "network-vif-plugged", "status": "completed", "tag": "a8ca804a-2879-4f45-91f3-f7ace366691d"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:04:45.190169 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:04:45.190169 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:04:45.196868 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-b7ae126b-0bbb-40f3-b7cd-0616b1c09624 req-3234d156-c5f6-4da5-b15a-7ccbd0a94052 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:45.197316 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-b7ae126b-0bbb-40f3-b7cd-0616b1c09624 req-3234d156-c5f6-4da5-b15a-7ccbd0a94052 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:45.208617 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-b7ae126b-0bbb-40f3-b7cd-0616b1c09624 req-3234d156-c5f6-4da5-b15a-7ccbd0a94052 service nova] Creating event network-vif-plugged:a8ca804a-2879-4f45-91f3-f7ace366691d for instance 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 on hv-cinder-82276 Feb 04 18:04:45.213465 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-b7ae126b-0bbb-40f3-b7cd-0616b1c09624 req-3234d156-c5f6-4da5-b15a-7ccbd0a94052 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028492 Feb 04 18:04:45.214042 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 263/520] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:04:45.536144 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-cc003bfe-6839-4886-bbca-b5cb44ffb433 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:45.536759 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-cc003bfe-6839-4886-bbca-b5cb44ffb433 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 680d8d06-f576-446b-b2de-326524afc5fb] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:45.589512 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-cc003bfe-6839-4886-bbca-b5cb44ffb433 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:45.596692 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-cc003bfe-6839-4886-bbca-b5cb44ffb433 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb" status: 200 len: 1213 microversion: 2.1 time: 0.064347 Feb 04 18:04:45.597519 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 258/521] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:45 2022] GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:45.758686 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ed136a88-d150-494d-9a4b-64b6260436a2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:45.759267 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ed136a88-d150-494d-9a4b-64b6260436a2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:45.765440 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ed136a88-d150-494d-9a4b-64b6260436a2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:45.765910 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ed136a88-d150-494d-9a4b-64b6260436a2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:45.766703 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ed136a88-d150-494d-9a4b-64b6260436a2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:45.767139 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ed136a88-d150-494d-9a4b-64b6260436a2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:45.798794 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ed136a88-d150-494d-9a4b-64b6260436a2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Going to try to terminate instance {{(pid=123566) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 04 18:04:45.914201 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-1cf4d879-4344-471f-af1d-9c3bbae482d7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:45.914825 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-1cf4d879-4344-471f-af1d-9c3bbae482d7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:45.921956 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1cf4d879-4344-471f-af1d-9c3bbae482d7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:45.922517 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1cf4d879-4344-471f-af1d-9c3bbae482d7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:45.923338 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1cf4d879-4344-471f-af1d-9c3bbae482d7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:45.923774 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1cf4d879-4344-471f-af1d-9c3bbae482d7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:45.950380 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-1cf4d879-4344-471f-af1d-9c3bbae482d7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Going to try to terminate instance {{(pid=123567) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 04 18:04:46.188341 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ed136a88-d150-494d-9a4b-64b6260436a2 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "DELETE /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 204 len: 0 microversion: 2.1 time: 0.433790 Feb 04 18:04:46.188939 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 264/522] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Feb 4 18:04:45 2022] DELETE /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 04 18:04:46.194112 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-5bc83039-9383-44d8-b60c-abf2050a821c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:46.197177 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-5bc83039-9383-44d8-b60c-abf2050a821c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:46.201331 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5bc83039-9383-44d8-b60c-abf2050a821c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:46.201783 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5bc83039-9383-44d8-b60c-abf2050a821c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:46.202813 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5bc83039-9383-44d8-b60c-abf2050a821c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:46.203253 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5bc83039-9383-44d8-b60c-abf2050a821c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:46.325439 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-1cf4d879-4344-471f-af1d-9c3bbae482d7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "DELETE /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 204 len: 0 microversion: 2.1 time: 0.415332 Feb 04 18:04:46.326150 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 259/523] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Feb 4 18:04:45 2022] DELETE /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 04 18:04:46.334305 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-34568d25-8081-46da-82a7-30b3f64632b7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:46.335038 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-34568d25-8081-46da-82a7-30b3f64632b7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:46.341783 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-34568d25-8081-46da-82a7-30b3f64632b7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:46.342316 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-34568d25-8081-46da-82a7-30b3f64632b7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:46.343728 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-34568d25-8081-46da-82a7-30b3f64632b7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:46.344228 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-34568d25-8081-46da-82a7-30b3f64632b7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:46.349087 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-5bc83039-9383-44d8-b60c-abf2050a821c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:46.356365 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-5bc83039-9383-44d8-b60c-abf2050a821c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1258 microversion: 2.1 time: 0.166148 Feb 04 18:04:46.356972 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 265/524] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:46 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:46.361939 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-d443da0b-c68c-49b4-9e60-6cb6401bc0bb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:46.362702 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-d443da0b-c68c-49b4-9e60-6cb6401bc0bb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:46.368869 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d443da0b-c68c-49b4-9e60-6cb6401bc0bb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:46.369323 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d443da0b-c68c-49b4-9e60-6cb6401bc0bb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:46.370106 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d443da0b-c68c-49b4-9e60-6cb6401bc0bb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:46.370590 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d443da0b-c68c-49b4-9e60-6cb6401bc0bb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:46.560086 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-d443da0b-c68c-49b4-9e60-6cb6401bc0bb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:46.563518 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-34568d25-8081-46da-82a7-30b3f64632b7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:46.569038 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-d443da0b-c68c-49b4-9e60-6cb6401bc0bb tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1509 microversion: 2.1 time: 0.211076 Feb 04 18:04:46.569748 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 266/525] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:46 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1509 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:46.571416 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-34568d25-8081-46da-82a7-30b3f64632b7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1515 microversion: 2.1 time: 0.240897 Feb 04 18:04:46.571989 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 260/526] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:46 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1515 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:46.613669 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-7bbe5a72-7558-44e0-9698-19a2f39f5617 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:46.614272 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-7bbe5a72-7558-44e0-9698-19a2f39f5617 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 680d8d06-f576-446b-b2de-326524afc5fb] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:46.620952 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7bbe5a72-7558-44e0-9698-19a2f39f5617 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:46.621402 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7bbe5a72-7558-44e0-9698-19a2f39f5617 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:46.622184 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7bbe5a72-7558-44e0-9698-19a2f39f5617 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:46.622664 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7bbe5a72-7558-44e0-9698-19a2f39f5617 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:46.683385 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-7bbe5a72-7558-44e0-9698-19a2f39f5617 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:46.691215 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-7bbe5a72-7558-44e0-9698-19a2f39f5617 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb" status: 200 len: 1209 microversion: 2.1 time: 0.081193 Feb 04 18:04:46.691782 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 267/527] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:46 2022] GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb => generated 1209 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:47.373750 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-2ed740d6-2061-4307-aafa-6846d59d1d13 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:47.374368 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-2ed740d6-2061-4307-aafa-6846d59d1d13 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:47.380537 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2ed740d6-2061-4307-aafa-6846d59d1d13 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:47.380984 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2ed740d6-2061-4307-aafa-6846d59d1d13 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:47.381762 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2ed740d6-2061-4307-aafa-6846d59d1d13 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:47.382198 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2ed740d6-2061-4307-aafa-6846d59d1d13 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:47.517962 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-2ed740d6-2061-4307-aafa-6846d59d1d13 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:47.526168 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-2ed740d6-2061-4307-aafa-6846d59d1d13 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1258 microversion: 2.1 time: 0.156056 Feb 04 18:04:47.526819 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 261/528] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:47 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:47.586413 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ee023848-e871-45a5-8edc-a91c27d583d6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:47.587216 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ee023848-e871-45a5-8edc-a91c27d583d6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:47.588730 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-24010939-7405-4030-b75f-9fc674d7b3eb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:47.589832 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-24010939-7405-4030-b75f-9fc674d7b3eb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:47.594704 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ee023848-e871-45a5-8edc-a91c27d583d6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:47.595463 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ee023848-e871-45a5-8edc-a91c27d583d6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:47.598133 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ee023848-e871-45a5-8edc-a91c27d583d6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:47.598133 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ee023848-e871-45a5-8edc-a91c27d583d6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:47.601379 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-24010939-7405-4030-b75f-9fc674d7b3eb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:47.601379 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-24010939-7405-4030-b75f-9fc674d7b3eb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:47.602163 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-24010939-7405-4030-b75f-9fc674d7b3eb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:47.602693 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-24010939-7405-4030-b75f-9fc674d7b3eb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:48.036159 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-24010939-7405-4030-b75f-9fc674d7b3eb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:48.041406 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-ee023848-e871-45a5-8edc-a91c27d583d6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:48.044286 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-24010939-7405-4030-b75f-9fc674d7b3eb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1515 microversion: 2.1 time: 0.459337 Feb 04 18:04:48.045065 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 262/529] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:47 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1515 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:48.049767 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-84c27ba1-5ae2-4665-87c6-cb5bf7a569c9 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:48.050615 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-84c27ba1-5ae2-4665-87c6-cb5bf7a569c9 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 680d8d06-f576-446b-b2de-326524afc5fb] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:48.051847 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ee023848-e871-45a5-8edc-a91c27d583d6 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1509 microversion: 2.1 time: 0.468944 Feb 04 18:04:48.054471 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 268/530] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:47 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1509 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:48.059415 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-84c27ba1-5ae2-4665-87c6-cb5bf7a569c9 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:48.060071 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-84c27ba1-5ae2-4665-87c6-cb5bf7a569c9 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:48.063672 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-84c27ba1-5ae2-4665-87c6-cb5bf7a569c9 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:48.063672 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-84c27ba1-5ae2-4665-87c6-cb5bf7a569c9 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:48.128196 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-84c27ba1-5ae2-4665-87c6-cb5bf7a569c9 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:48.135872 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-84c27ba1-5ae2-4665-87c6-cb5bf7a569c9 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb" status: 200 len: 1273 microversion: 2.1 time: 0.089896 Feb 04 18:04:48.136576 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 263/531] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:48 2022] GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb => generated 1273 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:48.550163 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-2c86e393-42de-49c5-9de9-c182d18065f8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:48.550803 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-2c86e393-42de-49c5-9de9-c182d18065f8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:48.556981 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2c86e393-42de-49c5-9de9-c182d18065f8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:48.557323 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2c86e393-42de-49c5-9de9-c182d18065f8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:48.558110 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2c86e393-42de-49c5-9de9-c182d18065f8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:48.558582 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2c86e393-42de-49c5-9de9-c182d18065f8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:48.700577 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2c86e393-42de-49c5-9de9-c182d18065f8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:48.710029 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-2c86e393-42de-49c5-9de9-c182d18065f8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1258 microversion: 2.1 time: 0.163397 Feb 04 18:04:48.710657 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 269/532] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:48 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:49.061196 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e391a959-1712-4fc9-97f0-46475d1f4c5d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:49.062317 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-e391a959-1712-4fc9-97f0-46475d1f4c5d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:49.068479 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e391a959-1712-4fc9-97f0-46475d1f4c5d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:49.068675 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-de06e801-5264-4a40-b2b4-737b510720c2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:49.068929 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e391a959-1712-4fc9-97f0-46475d1f4c5d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:49.069218 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-de06e801-5264-4a40-b2b4-737b510720c2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:49.069706 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e391a959-1712-4fc9-97f0-46475d1f4c5d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:49.070139 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e391a959-1712-4fc9-97f0-46475d1f4c5d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:49.075040 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-de06e801-5264-4a40-b2b4-737b510720c2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:49.075494 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-de06e801-5264-4a40-b2b4-737b510720c2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:49.076278 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-de06e801-5264-4a40-b2b4-737b510720c2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:49.076719 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-de06e801-5264-4a40-b2b4-737b510720c2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:49.276769 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e391a959-1712-4fc9-97f0-46475d1f4c5d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:49.280355 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-de06e801-5264-4a40-b2b4-737b510720c2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:49.285588 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e391a959-1712-4fc9-97f0-46475d1f4c5d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1515 microversion: 2.1 time: 0.228418 Feb 04 18:04:49.294854 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 264/533] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:49 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1515 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:49.295082 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-de06e801-5264-4a40-b2b4-737b510720c2 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1509 microversion: 2.1 time: 0.223409 Feb 04 18:04:49.295203 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-5b2490d3-3ee3-4f0b-86a0-db8aa0d85f3e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:49.295203 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-5b2490d3-3ee3-4f0b-86a0-db8aa0d85f3e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 680d8d06-f576-446b-b2de-326524afc5fb] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:49.298557 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5b2490d3-3ee3-4f0b-86a0-db8aa0d85f3e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:49.299009 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5b2490d3-3ee3-4f0b-86a0-db8aa0d85f3e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:49.299728 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 270/534] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:49 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1509 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:49.299917 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5b2490d3-3ee3-4f0b-86a0-db8aa0d85f3e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:49.300242 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5b2490d3-3ee3-4f0b-86a0-db8aa0d85f3e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:49.431020 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5b2490d3-3ee3-4f0b-86a0-db8aa0d85f3e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:49.439533 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-5b2490d3-3ee3-4f0b-86a0-db8aa0d85f3e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb" status: 200 len: 1313 microversion: 2.1 time: 0.151994 Feb 04 18:04:49.440192 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 265/535] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:49 2022] GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:49.726783 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-7656199d-b315-49ae-8f74-8f6c6f166be7 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:49.727403 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-7656199d-b315-49ae-8f74-8f6c6f166be7 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:49.734157 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7656199d-b315-49ae-8f74-8f6c6f166be7 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:49.734640 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7656199d-b315-49ae-8f74-8f6c6f166be7 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:49.735432 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7656199d-b315-49ae-8f74-8f6c6f166be7 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:49.735870 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7656199d-b315-49ae-8f74-8f6c6f166be7 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:49.875252 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-7656199d-b315-49ae-8f74-8f6c6f166be7 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:49.882777 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-7656199d-b315-49ae-8f74-8f6c6f166be7 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1443 microversion: 2.1 time: 0.160216 Feb 04 18:04:49.883407 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 271/536] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:49 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1443 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:49.899871 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-39c836f0-b761-49c5-87e9-dd48f5595960 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:49.900583 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-39c836f0-b761-49c5-87e9-dd48f5595960 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:49.910669 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-39c836f0-b761-49c5-87e9-dd48f5595960 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:49.911118 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-39c836f0-b761-49c5-87e9-dd48f5595960 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:49.911896 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-39c836f0-b761-49c5-87e9-dd48f5595960 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:49.912751 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-39c836f0-b761-49c5-87e9-dd48f5595960 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:49.917403 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-9e13085d-5ed0-4142-b78d-61d09f80daf2 req-a8329a09-8582-4556-8786-19bc43196fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "680d8d06-f576-446b-b2de-326524afc5fb", "tag": "7a82baa8-3397-462f-b2ef-4e1a91ad73ef"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:04:49.921366 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:04:49.921366 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:04:49.933386 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-9e13085d-5ed0-4142-b78d-61d09f80daf2 req-a8329a09-8582-4556-8786-19bc43196fb4 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:49.933997 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-9e13085d-5ed0-4142-b78d-61d09f80daf2 req-a8329a09-8582-4556-8786-19bc43196fb4 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:49.950476 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-9e13085d-5ed0-4142-b78d-61d09f80daf2 req-a8329a09-8582-4556-8786-19bc43196fb4 service nova] Creating event network-changed:7a82baa8-3397-462f-b2ef-4e1a91ad73ef for instance 680d8d06-f576-446b-b2de-326524afc5fb on hv-cinder-82276 Feb 04 18:04:49.956832 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-9e13085d-5ed0-4142-b78d-61d09f80daf2 req-a8329a09-8582-4556-8786-19bc43196fb4 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042932 Feb 04 18:04:49.957685 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 272/537] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:04:50.050703 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-39c836f0-b761-49c5-87e9-dd48f5595960 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:50.058435 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-39c836f0-b761-49c5-87e9-dd48f5595960 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1443 microversion: 2.1 time: 0.162301 Feb 04 18:04:50.059045 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 266/538] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:49 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1443 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:50.305121 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-108ac45c-d14c-47b3-b236-cba41ef7e09b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:50.306036 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-108ac45c-d14c-47b3-b236-cba41ef7e09b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:50.306245 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-3e393212-a1a3-4a39-861f-a42543df34df tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:50.307096 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-3e393212-a1a3-4a39-861f-a42543df34df tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:50.313497 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-108ac45c-d14c-47b3-b236-cba41ef7e09b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:50.314359 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-108ac45c-d14c-47b3-b236-cba41ef7e09b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:50.315463 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3e393212-a1a3-4a39-861f-a42543df34df tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:50.315802 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3e393212-a1a3-4a39-861f-a42543df34df tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:50.316413 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-108ac45c-d14c-47b3-b236-cba41ef7e09b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:50.316729 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3e393212-a1a3-4a39-861f-a42543df34df tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:50.317053 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-108ac45c-d14c-47b3-b236-cba41ef7e09b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:50.317177 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3e393212-a1a3-4a39-861f-a42543df34df tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:50.571036 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-3e393212-a1a3-4a39-861f-a42543df34df tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:50.577310 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-108ac45c-d14c-47b3-b236-cba41ef7e09b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:50.579442 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-3e393212-a1a3-4a39-861f-a42543df34df tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1515 microversion: 2.1 time: 0.278769 Feb 04 18:04:50.580018 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 273/539] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:50 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1515 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:50.584491 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-7698fad2-3652-4ca3-962b-c21f5adfc217 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:50.585323 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-7698fad2-3652-4ca3-962b-c21f5adfc217 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 680d8d06-f576-446b-b2de-326524afc5fb] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:50.591197 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7698fad2-3652-4ca3-962b-c21f5adfc217 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:50.591644 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7698fad2-3652-4ca3-962b-c21f5adfc217 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:50.592470 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7698fad2-3652-4ca3-962b-c21f5adfc217 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:50.593433 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7698fad2-3652-4ca3-962b-c21f5adfc217 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:50.593953 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-108ac45c-d14c-47b3-b236-cba41ef7e09b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1509 microversion: 2.1 time: 0.292821 Feb 04 18:04:50.594947 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 267/540] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:50 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1509 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:50.821109 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-7698fad2-3652-4ca3-962b-c21f5adfc217 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:50.825851 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-7698fad2-3652-4ca3-962b-c21f5adfc217 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb" status: 200 len: 1313 microversion: 2.1 time: 0.244682 Feb 04 18:04:50.826569 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 274/541] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:50 2022] GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:51.596570 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-1dfe8cb6-a56e-4499-a16f-5b9248ead2ea tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:51.597839 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-1dfe8cb6-a56e-4499-a16f-5b9248ead2ea tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:51.606386 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1dfe8cb6-a56e-4499-a16f-5b9248ead2ea tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:51.607188 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1dfe8cb6-a56e-4499-a16f-5b9248ead2ea tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:51.608979 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1dfe8cb6-a56e-4499-a16f-5b9248ead2ea tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:51.611388 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1dfe8cb6-a56e-4499-a16f-5b9248ead2ea tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:51.611514 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-f7a96bc1-c1fe-4de4-9cec-b2bbcaa30b23 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:51.611514 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-f7a96bc1-c1fe-4de4-9cec-b2bbcaa30b23 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:51.617854 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f7a96bc1-c1fe-4de4-9cec-b2bbcaa30b23 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:51.619220 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f7a96bc1-c1fe-4de4-9cec-b2bbcaa30b23 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:51.620242 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f7a96bc1-c1fe-4de4-9cec-b2bbcaa30b23 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:51.620704 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f7a96bc1-c1fe-4de4-9cec-b2bbcaa30b23 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:51.903759 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-1dfe8cb6-a56e-4499-a16f-5b9248ead2ea tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:51.913571 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-1dfe8cb6-a56e-4499-a16f-5b9248ead2ea tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1515 microversion: 2.1 time: 0.321160 Feb 04 18:04:51.914396 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 268/542] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:51 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1515 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:51.918896 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e3c60048-5b76-4e28-8f4b-5cc86be167d4 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:51.921143 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-e3c60048-5b76-4e28-8f4b-5cc86be167d4 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 680d8d06-f576-446b-b2de-326524afc5fb] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:51.922663 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-f7a96bc1-c1fe-4de4-9cec-b2bbcaa30b23 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:51.926387 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e3c60048-5b76-4e28-8f4b-5cc86be167d4 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:51.927109 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e3c60048-5b76-4e28-8f4b-5cc86be167d4 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:51.927948 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e3c60048-5b76-4e28-8f4b-5cc86be167d4 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:51.928558 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e3c60048-5b76-4e28-8f4b-5cc86be167d4 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:51.930224 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-f7a96bc1-c1fe-4de4-9cec-b2bbcaa30b23 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1509 microversion: 2.1 time: 0.323086 Feb 04 18:04:51.930831 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 275/543] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:51 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1509 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:51.971654 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-ab5c2ffe-18ca-4fa5-9b00-4cfdda1257bc req-6e1d8a1b-e9e2-485d-b671-2d17e2f417d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c35f5dd4-8689-4c1f-b63d-3562678b8e1c", "name": "network-vif-deleted", "tag": "dc7e48d9-28db-43df-a99d-b317c0c45623"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:04:51.973393 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:04:51.973393 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:04:51.985530 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-ab5c2ffe-18ca-4fa5-9b00-4cfdda1257bc req-6e1d8a1b-e9e2-485d-b671-2d17e2f417d7 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:51.986047 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-ab5c2ffe-18ca-4fa5-9b00-4cfdda1257bc req-6e1d8a1b-e9e2-485d-b671-2d17e2f417d7 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:51.999459 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-ab5c2ffe-18ca-4fa5-9b00-4cfdda1257bc req-6e1d8a1b-e9e2-485d-b671-2d17e2f417d7 service nova] Creating event network-vif-deleted:dc7e48d9-28db-43df-a99d-b317c0c45623 for instance c35f5dd4-8689-4c1f-b63d-3562678b8e1c on hv-cinder-82276 Feb 04 18:04:52.005145 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-ab5c2ffe-18ca-4fa5-9b00-4cfdda1257bc req-6e1d8a1b-e9e2-485d-b671-2d17e2f417d7 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036597 Feb 04 18:04:52.006600 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 276/544] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:04:52.260713 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e3c60048-5b76-4e28-8f4b-5cc86be167d4 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:52.268291 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e3c60048-5b76-4e28-8f4b-5cc86be167d4 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb" status: 200 len: 1313 microversion: 2.1 time: 0.352646 Feb 04 18:04:52.268868 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 269/545] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:51 2022] GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:52.781938 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-0b8c8289-d157-473d-815c-f1663f64e01d req-3f82d374-5ecc-41c1-bcfd-1faaf541e055 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78c4e346-86a3-4ecf-b0a8-5de2dced1ef1", "tag": "a8ca804a-2879-4f45-91f3-f7ace366691d"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:04:52.783684 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:04:52.783684 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:04:52.791565 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-0b8c8289-d157-473d-815c-f1663f64e01d req-3f82d374-5ecc-41c1-bcfd-1faaf541e055 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:52.792008 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-0b8c8289-d157-473d-815c-f1663f64e01d req-3f82d374-5ecc-41c1-bcfd-1faaf541e055 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:52.802920 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-0b8c8289-d157-473d-815c-f1663f64e01d req-3f82d374-5ecc-41c1-bcfd-1faaf541e055 service nova] Creating event network-changed:a8ca804a-2879-4f45-91f3-f7ace366691d for instance 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 on hv-cinder-82276 Feb 04 18:04:52.807885 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-0b8c8289-d157-473d-815c-f1663f64e01d req-3f82d374-5ecc-41c1-bcfd-1faaf541e055 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030493 Feb 04 18:04:52.808567 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 277/546] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:04:52.931451 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-6dafb770-c8f3-4bcf-b1d3-adc22889209d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:52.932789 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-6dafb770-c8f3-4bcf-b1d3-adc22889209d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:52.941406 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6dafb770-c8f3-4bcf-b1d3-adc22889209d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:52.942201 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6dafb770-c8f3-4bcf-b1d3-adc22889209d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:52.943247 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6dafb770-c8f3-4bcf-b1d3-adc22889209d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:52.943972 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6dafb770-c8f3-4bcf-b1d3-adc22889209d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:52.948379 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-e35e7a1f-328b-432a-9b78-a7d3e6bc5c28 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:52.949729 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-e35e7a1f-328b-432a-9b78-a7d3e6bc5c28 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:52.957055 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e35e7a1f-328b-432a-9b78-a7d3e6bc5c28 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:52.957785 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e35e7a1f-328b-432a-9b78-a7d3e6bc5c28 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:52.958795 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e35e7a1f-328b-432a-9b78-a7d3e6bc5c28 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:52.959393 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e35e7a1f-328b-432a-9b78-a7d3e6bc5c28 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:52.993380 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6dafb770-c8f3-4bcf-b1d3-adc22889209d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:52.994799 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6dafb770-c8f3-4bcf-b1d3-adc22889209d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:52.995507 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.objects.instance [None req-6dafb770-c8f3-4bcf-b1d3-adc22889209d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lazy-loading 'fault' on Instance uuid c35f5dd4-8689-4c1f-b63d-3562678b8e1c {{(pid=123567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:04:53.034111 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-e35e7a1f-328b-432a-9b78-a7d3e6bc5c28 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:53.042587 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-e35e7a1f-328b-432a-9b78-a7d3e6bc5c28 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1293 microversion: 2.1 time: 0.098526 Feb 04 18:04:53.054978 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 278/547] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:52 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1293 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:53.079800 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-6dafb770-c8f3-4bcf-b1d3-adc22889209d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:53.092978 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-6dafb770-c8f3-4bcf-b1d3-adc22889209d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 200 len: 1308 microversion: 2.1 time: 0.165616 Feb 04 18:04:53.105617 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 270/548] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:52 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 1308 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:53.285913 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-c2aa35c1-c32a-4689-b7c5-d960d5af35f3 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:53.286706 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-c2aa35c1-c32a-4689-b7c5-d960d5af35f3 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 680d8d06-f576-446b-b2de-326524afc5fb] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:53.293762 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c2aa35c1-c32a-4689-b7c5-d960d5af35f3 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:53.294347 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c2aa35c1-c32a-4689-b7c5-d960d5af35f3 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:53.295246 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c2aa35c1-c32a-4689-b7c5-d960d5af35f3 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:53.296287 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c2aa35c1-c32a-4689-b7c5-d960d5af35f3 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:53.445217 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c2aa35c1-c32a-4689-b7c5-d960d5af35f3 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:53.452930 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-c2aa35c1-c32a-4689-b7c5-d960d5af35f3 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb" status: 200 len: 1313 microversion: 2.1 time: 0.170677 Feb 04 18:04:53.462771 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 279/549] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:53 2022] GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:54.020524 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-257fc03f-5cda-45ee-a8b8-e1fa35e41bc9 req-781a1d2c-1adc-4da1-871f-0baaa6473f4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374b4453-744e-4cb1-a6f4-b8c4d48e3a5f", "name": "network-vif-deleted", "tag": "5c15984f-de2a-4353-acb0-e4952295b2eb"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:04:54.022271 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:04:54.022271 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:04:54.029749 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-257fc03f-5cda-45ee-a8b8-e1fa35e41bc9 req-781a1d2c-1adc-4da1-871f-0baaa6473f4c service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:54.030802 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-257fc03f-5cda-45ee-a8b8-e1fa35e41bc9 req-781a1d2c-1adc-4da1-871f-0baaa6473f4c service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:54.042852 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-257fc03f-5cda-45ee-a8b8-e1fa35e41bc9 req-781a1d2c-1adc-4da1-871f-0baaa6473f4c service nova] Creating event network-vif-deleted:5c15984f-de2a-4353-acb0-e4952295b2eb for instance 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f on hv-cinder-82276 Feb 04 18:04:54.047750 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-257fc03f-5cda-45ee-a8b8-e1fa35e41bc9 req-781a1d2c-1adc-4da1-871f-0baaa6473f4c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030873 Feb 04 18:04:54.048354 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 271/550] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:04:54.058764 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-227aeb86-dd5a-4046-bc98-2d4ef3191b0e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:54.059376 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-227aeb86-dd5a-4046-bc98-2d4ef3191b0e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:54.065640 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-227aeb86-dd5a-4046-bc98-2d4ef3191b0e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:54.066102 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-227aeb86-dd5a-4046-bc98-2d4ef3191b0e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:54.067058 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-227aeb86-dd5a-4046-bc98-2d4ef3191b0e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:54.067352 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-227aeb86-dd5a-4046-bc98-2d4ef3191b0e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:54.098405 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-227aeb86-dd5a-4046-bc98-2d4ef3191b0e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:54.098889 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-227aeb86-dd5a-4046-bc98-2d4ef3191b0e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:54.099347 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.objects.instance [None req-227aeb86-dd5a-4046-bc98-2d4ef3191b0e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lazy-loading 'fault' on Instance uuid 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f {{(pid=123566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:04:54.118750 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-9804ba29-7d38-4dab-ae70-a7c26a525a71 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:54.119602 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-9804ba29-7d38-4dab-ae70-a7c26a525a71 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c35f5dd4-8689-4c1f-b63d-3562678b8e1c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:54.126090 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9804ba29-7d38-4dab-ae70-a7c26a525a71 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:54.126506 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9804ba29-7d38-4dab-ae70-a7c26a525a71 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:54.127295 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9804ba29-7d38-4dab-ae70-a7c26a525a71 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:54.127730 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9804ba29-7d38-4dab-ae70-a7c26a525a71 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:54.142585 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.wsgi [None req-9804ba29-7d38-4dab-ae70-a7c26a525a71 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] HTTP exception thrown: Instance c35f5dd4-8689-4c1f-b63d-3562678b8e1c could not be found. Feb 04 18:04:54.143411 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-9804ba29-7d38-4dab-ae70-a7c26a525a71 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Returning 404 to user: Instance c35f5dd4-8689-4c1f-b63d-3562678b8e1c could not be found. {{(pid=123567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:04:54.144324 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-9804ba29-7d38-4dab-ae70-a7c26a525a71 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c" status: 404 len: 111 microversion: 2.1 time: 0.029965 Feb 04 18:04:54.145275 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 272/551] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:54 2022] GET /compute/v2.1/servers/c35f5dd4-8689-4c1f-b63d-3562678b8e1c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 04 18:04:54.152450 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-227aeb86-dd5a-4046-bc98-2d4ef3191b0e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:54.161870 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-227aeb86-dd5a-4046-bc98-2d4ef3191b0e tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 200 len: 1312 microversion: 2.1 time: 0.106601 Feb 04 18:04:54.162481 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 280/552] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:54 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 1312 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:54.469546 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-47e81f0c-46aa-43a3-9a8f-f8dd65364a09 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:54.471716 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-47e81f0c-46aa-43a3-9a8f-f8dd65364a09 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 680d8d06-f576-446b-b2de-326524afc5fb] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:54.476306 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-47e81f0c-46aa-43a3-9a8f-f8dd65364a09 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:54.476762 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-47e81f0c-46aa-43a3-9a8f-f8dd65364a09 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:54.477540 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-47e81f0c-46aa-43a3-9a8f-f8dd65364a09 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:54.477982 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-47e81f0c-46aa-43a3-9a8f-f8dd65364a09 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:54.614202 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-47e81f0c-46aa-43a3-9a8f-f8dd65364a09 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:54.621789 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-47e81f0c-46aa-43a3-9a8f-f8dd65364a09 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb" status: 200 len: 1313 microversion: 2.1 time: 0.155915 Feb 04 18:04:54.622360 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 273/553] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:54 2022] GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:55.181328 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-d8d6ed10-90b7-4452-8efa-c2d7e53192ff tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:55.182040 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-d8d6ed10-90b7-4452-8efa-c2d7e53192ff tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:55.189202 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d8d6ed10-90b7-4452-8efa-c2d7e53192ff tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:55.189736 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d8d6ed10-90b7-4452-8efa-c2d7e53192ff tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:55.190647 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d8d6ed10-90b7-4452-8efa-c2d7e53192ff tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:55.191094 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d8d6ed10-90b7-4452-8efa-c2d7e53192ff tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:55.205104 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-d8d6ed10-90b7-4452-8efa-c2d7e53192ff tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] HTTP exception thrown: Instance 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f could not be found. Feb 04 18:04:55.205703 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-d8d6ed10-90b7-4452-8efa-c2d7e53192ff tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Returning 404 to user: Instance 374b4453-744e-4cb1-a6f4-b8c4d48e3a5f could not be found. {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:04:55.206567 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-d8d6ed10-90b7-4452-8efa-c2d7e53192ff tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f" status: 404 len: 111 microversion: 2.1 time: 0.028982 Feb 04 18:04:55.207219 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 281/554] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:55 2022] GET /compute/v2.1/servers/374b4453-744e-4cb1-a6f4-b8c4d48e3a5f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:04:55.216583 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-4c2b3b76-637a-4efe-8458-0f2a793cb00c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:55.217350 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-4c2b3b76-637a-4efe-8458-0f2a793cb00c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:55.223499 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4c2b3b76-637a-4efe-8458-0f2a793cb00c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:55.223948 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4c2b3b76-637a-4efe-8458-0f2a793cb00c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:55.224723 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4c2b3b76-637a-4efe-8458-0f2a793cb00c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:55.225152 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4c2b3b76-637a-4efe-8458-0f2a793cb00c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:55.251408 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-4c2b3b76-637a-4efe-8458-0f2a793cb00c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Going to try to terminate instance {{(pid=123567) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 04 18:04:55.638333 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b8fe0f4b-111c-43e3-86a4-1b5104b166cc tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:55.639033 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-b8fe0f4b-111c-43e3-86a4-1b5104b166cc tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 680d8d06-f576-446b-b2de-326524afc5fb] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:55.644996 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b8fe0f4b-111c-43e3-86a4-1b5104b166cc tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:55.645461 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b8fe0f4b-111c-43e3-86a4-1b5104b166cc tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:55.646223 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b8fe0f4b-111c-43e3-86a4-1b5104b166cc tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:55.646689 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b8fe0f4b-111c-43e3-86a4-1b5104b166cc tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:55.666540 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-4c2b3b76-637a-4efe-8458-0f2a793cb00c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "DELETE /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 204 len: 0 microversion: 2.1 time: 0.453393 Feb 04 18:04:55.667164 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 274/555] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Feb 4 18:04:55 2022] DELETE /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 04 18:04:55.678104 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-2ec01fb4-5fba-420f-8d1a-08867daab600 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:55.678883 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-2ec01fb4-5fba-420f-8d1a-08867daab600 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:55.685777 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2ec01fb4-5fba-420f-8d1a-08867daab600 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:55.686920 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2ec01fb4-5fba-420f-8d1a-08867daab600 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:55.687780 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2ec01fb4-5fba-420f-8d1a-08867daab600 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:55.688358 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2ec01fb4-5fba-420f-8d1a-08867daab600 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:55.843793 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-b8fe0f4b-111c-43e3-86a4-1b5104b166cc tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:55.851954 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-b8fe0f4b-111c-43e3-86a4-1b5104b166cc tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb" status: 200 len: 1313 microversion: 2.1 time: 0.217216 Feb 04 18:04:55.853588 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 282/556] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:55 2022] GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:55.873400 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-2ec01fb4-5fba-420f-8d1a-08867daab600 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:55.881650 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-2ec01fb4-5fba-420f-8d1a-08867daab600 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.209221 Feb 04 18:04:55.882212 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 275/557] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:55 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:56.547118 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-4cc2dbbc-0b8f-4b7e-94a4-e609219cafc4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:56.547645 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-4cc2dbbc-0b8f-4b7e-94a4-e609219cafc4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:56.553813 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4cc2dbbc-0b8f-4b7e-94a4-e609219cafc4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:56.554257 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4cc2dbbc-0b8f-4b7e-94a4-e609219cafc4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:56.555062 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4cc2dbbc-0b8f-4b7e-94a4-e609219cafc4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:56.555497 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4cc2dbbc-0b8f-4b7e-94a4-e609219cafc4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:56.579470 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-4cc2dbbc-0b8f-4b7e-94a4-e609219cafc4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Going to try to terminate instance {{(pid=123566) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 04 18:04:56.869265 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-9676af28-eb1b-45fa-8741-70f95e1928d6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:56.869824 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-9676af28-eb1b-45fa-8741-70f95e1928d6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 680d8d06-f576-446b-b2de-326524afc5fb] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:56.876263 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9676af28-eb1b-45fa-8741-70f95e1928d6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:56.876708 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9676af28-eb1b-45fa-8741-70f95e1928d6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:56.877475 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9676af28-eb1b-45fa-8741-70f95e1928d6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:56.877911 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9676af28-eb1b-45fa-8741-70f95e1928d6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:57.012994 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-9676af28-eb1b-45fa-8741-70f95e1928d6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:57.020785 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-9676af28-eb1b-45fa-8741-70f95e1928d6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb" status: 200 len: 1313 microversion: 2.1 time: 0.155259 Feb 04 18:04:57.021810 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 276/558] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:56 2022] GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:57.025683 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-5921958c-9e65-41a7-95be-23321126f210 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:57.026279 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-5921958c-9e65-41a7-95be-23321126f210 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:57.032478 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5921958c-9e65-41a7-95be-23321126f210 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:57.032929 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5921958c-9e65-41a7-95be-23321126f210 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:57.033716 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5921958c-9e65-41a7-95be-23321126f210 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:57.033936 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-4cc2dbbc-0b8f-4b7e-94a4-e609219cafc4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "DELETE /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 204 len: 0 microversion: 2.1 time: 0.490581 Feb 04 18:04:57.034148 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5921958c-9e65-41a7-95be-23321126f210 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:57.034538 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 283/559] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Feb 4 18:04:56 2022] DELETE /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 04 18:04:57.042612 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-d4cf0fa7-1189-41d1-84e1-6f64c6012923 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:57.043537 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-d4cf0fa7-1189-41d1-84e1-6f64c6012923 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:57.050667 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d4cf0fa7-1189-41d1-84e1-6f64c6012923 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:57.050667 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d4cf0fa7-1189-41d1-84e1-6f64c6012923 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:57.050667 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d4cf0fa7-1189-41d1-84e1-6f64c6012923 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:57.051099 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d4cf0fa7-1189-41d1-84e1-6f64c6012923 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:57.232934 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5921958c-9e65-41a7-95be-23321126f210 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:57.240389 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-5921958c-9e65-41a7-95be-23321126f210 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.217805 Feb 04 18:04:57.241085 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 277/560] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:57 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:57.244099 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-d4cf0fa7-1189-41d1-84e1-6f64c6012923 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:57.251434 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-d4cf0fa7-1189-41d1-84e1-6f64c6012923 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1513 microversion: 2.1 time: 0.212718 Feb 04 18:04:57.252006 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 284/561] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:57 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1513 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:04:58.037044 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c0b5cea7-c082-4527-9bed-b645aaa1333b tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:58.037745 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c0b5cea7-c082-4527-9bed-b645aaa1333b tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 680d8d06-f576-446b-b2de-326524afc5fb] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:58.044146 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c0b5cea7-c082-4527-9bed-b645aaa1333b tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:58.044731 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c0b5cea7-c082-4527-9bed-b645aaa1333b tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:58.046126 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c0b5cea7-c082-4527-9bed-b645aaa1333b tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:58.046618 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c0b5cea7-c082-4527-9bed-b645aaa1333b tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:58.192366 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c0b5cea7-c082-4527-9bed-b645aaa1333b tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:58.200104 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c0b5cea7-c082-4527-9bed-b645aaa1333b tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb" status: 200 len: 1313 microversion: 2.1 time: 0.166791 Feb 04 18:04:58.200690 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 278/562] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:58 2022] GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:58.257096 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-8730b7c3-183d-4750-bdcd-f4916ec29dc7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:58.257902 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-8730b7c3-183d-4750-bdcd-f4916ec29dc7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:58.265457 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8730b7c3-183d-4750-bdcd-f4916ec29dc7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:58.265979 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8730b7c3-183d-4750-bdcd-f4916ec29dc7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:58.266803 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8730b7c3-183d-4750-bdcd-f4916ec29dc7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:58.267247 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8730b7c3-183d-4750-bdcd-f4916ec29dc7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:58.270187 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b1549ecc-5b82-441c-9e36-e6c9865e0158 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:58.270834 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-b1549ecc-5b82-441c-9e36-e6c9865e0158 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:58.276832 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b1549ecc-5b82-441c-9e36-e6c9865e0158 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:58.278127 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b1549ecc-5b82-441c-9e36-e6c9865e0158 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:58.278567 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b1549ecc-5b82-441c-9e36-e6c9865e0158 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:58.279013 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b1549ecc-5b82-441c-9e36-e6c9865e0158 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:58.474354 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-8730b7c3-183d-4750-bdcd-f4916ec29dc7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:58.478679 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-b1549ecc-5b82-441c-9e36-e6c9865e0158 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:58.486828 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b1549ecc-5b82-441c-9e36-e6c9865e0158 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1513 microversion: 2.1 time: 0.220220 Feb 04 18:04:58.487700 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 279/563] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:58 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1513 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:58.488766 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-8730b7c3-183d-4750-bdcd-f4916ec29dc7 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.235314 Feb 04 18:04:58.489386 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 285/564] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:58 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:59.217088 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-8c0a503e-02f7-45e5-b05e-bc883c25f066 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:59.217695 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-8c0a503e-02f7-45e5-b05e-bc883c25f066 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 680d8d06-f576-446b-b2de-326524afc5fb] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:59.223998 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8c0a503e-02f7-45e5-b05e-bc883c25f066 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:59.224453 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8c0a503e-02f7-45e5-b05e-bc883c25f066 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:59.225247 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8c0a503e-02f7-45e5-b05e-bc883c25f066 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:59.225686 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8c0a503e-02f7-45e5-b05e-bc883c25f066 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:59.280864 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-7ea4cd56-3e0a-4839-a41c-d6b6cea18a27 req-85f0e459-8b5a-4f20-bd53-afd17b0c0990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "680d8d06-f576-446b-b2de-326524afc5fb", "name": "network-vif-plugged", "status": "completed", "tag": "7a82baa8-3397-462f-b2ef-4e1a91ad73ef"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:04:59.282773 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:04:59.282773 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:04:59.290860 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-7ea4cd56-3e0a-4839-a41c-d6b6cea18a27 req-85f0e459-8b5a-4f20-bd53-afd17b0c0990 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:59.291312 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-7ea4cd56-3e0a-4839-a41c-d6b6cea18a27 req-85f0e459-8b5a-4f20-bd53-afd17b0c0990 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:59.303632 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-7ea4cd56-3e0a-4839-a41c-d6b6cea18a27 req-85f0e459-8b5a-4f20-bd53-afd17b0c0990 service nova] Creating event network-vif-plugged:7a82baa8-3397-462f-b2ef-4e1a91ad73ef for instance 680d8d06-f576-446b-b2de-326524afc5fb on hv-cinder-82276 Feb 04 18:04:59.308316 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-7ea4cd56-3e0a-4839-a41c-d6b6cea18a27 req-85f0e459-8b5a-4f20-bd53-afd17b0c0990 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031168 Feb 04 18:04:59.308917 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 286/565] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:04:59.362354 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-8c0a503e-02f7-45e5-b05e-bc883c25f066 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:59.370016 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-8c0a503e-02f7-45e5-b05e-bc883c25f066 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb" status: 200 len: 1313 microversion: 2.1 time: 0.156636 Feb 04 18:04:59.370638 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 280/566] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:59 2022] GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:59.504683 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-f54e1d67-8a2b-4971-9fe8-446de0c97fc9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:59.505426 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-f54e1d67-8a2b-4971-9fe8-446de0c97fc9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:59.505776 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-2e71190d-3b2d-4412-ad2d-46836f79319b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:04:59.506479 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-2e71190d-3b2d-4412-ad2d-46836f79319b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:04:59.511807 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f54e1d67-8a2b-4971-9fe8-446de0c97fc9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:59.512253 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f54e1d67-8a2b-4971-9fe8-446de0c97fc9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:59.512731 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2e71190d-3b2d-4412-ad2d-46836f79319b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:59.513027 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f54e1d67-8a2b-4971-9fe8-446de0c97fc9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:59.513181 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2e71190d-3b2d-4412-ad2d-46836f79319b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:59.513458 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f54e1d67-8a2b-4971-9fe8-446de0c97fc9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:59.513955 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2e71190d-3b2d-4412-ad2d-46836f79319b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:04:59.514482 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2e71190d-3b2d-4412-ad2d-46836f79319b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:04:59.714110 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-2e71190d-3b2d-4412-ad2d-46836f79319b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:59.722152 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-2e71190d-3b2d-4412-ad2d-46836f79319b tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.220307 Feb 04 18:04:59.722298 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-f54e1d67-8a2b-4971-9fe8-446de0c97fc9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:04:59.723141 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 281/567] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:59 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:04:59.730510 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-f54e1d67-8a2b-4971-9fe8-446de0c97fc9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1513 microversion: 2.1 time: 0.229741 Feb 04 18:04:59.731089 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 287/568] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:04:59 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1513 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:00.387549 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-1b1e68a8-aa21-49d8-a54e-d76e569e9dcd tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:00.388159 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-1b1e68a8-aa21-49d8-a54e-d76e569e9dcd tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 680d8d06-f576-446b-b2de-326524afc5fb] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:00.394581 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1b1e68a8-aa21-49d8-a54e-d76e569e9dcd tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:00.395014 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1b1e68a8-aa21-49d8-a54e-d76e569e9dcd tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:00.395791 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1b1e68a8-aa21-49d8-a54e-d76e569e9dcd tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:00.396230 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1b1e68a8-aa21-49d8-a54e-d76e569e9dcd tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:00.533881 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-1b1e68a8-aa21-49d8-a54e-d76e569e9dcd tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:00.542007 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-1b1e68a8-aa21-49d8-a54e-d76e569e9dcd tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb" status: 200 len: 1313 microversion: 2.1 time: 0.158071 Feb 04 18:05:00.542628 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 282/569] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:00 2022] GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:00.738791 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-561aafe4-7c29-4899-bbfc-b1b34d5ae02c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:00.739428 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-561aafe4-7c29-4899-bbfc-b1b34d5ae02c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:00.746792 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-dbf27273-80d1-4750-a000-d832a220dbbf tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:00.747003 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-561aafe4-7c29-4899-bbfc-b1b34d5ae02c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:00.747403 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-561aafe4-7c29-4899-bbfc-b1b34d5ae02c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:00.747537 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-dbf27273-80d1-4750-a000-d832a220dbbf tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:00.748377 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-561aafe4-7c29-4899-bbfc-b1b34d5ae02c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:00.748964 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-561aafe4-7c29-4899-bbfc-b1b34d5ae02c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:00.753384 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dbf27273-80d1-4750-a000-d832a220dbbf tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:00.753840 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dbf27273-80d1-4750-a000-d832a220dbbf tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:00.754667 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dbf27273-80d1-4750-a000-d832a220dbbf tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:00.755111 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dbf27273-80d1-4750-a000-d832a220dbbf tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:00.948164 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-dbf27273-80d1-4750-a000-d832a220dbbf tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:00.951167 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-561aafe4-7c29-4899-bbfc-b1b34d5ae02c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:00.956192 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-dbf27273-80d1-4750-a000-d832a220dbbf tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1513 microversion: 2.1 time: 0.213012 Feb 04 18:05:00.956771 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 283/570] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:00 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1513 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:05:00.960401 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-561aafe4-7c29-4899-bbfc-b1b34d5ae02c tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.224055 Feb 04 18:05:00.960401 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 288/571] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:00 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:01.558852 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-cae49fde-9ec0-4e0a-b72a-ed0f580c5b89 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:01.559508 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-cae49fde-9ec0-4e0a-b72a-ed0f580c5b89 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 680d8d06-f576-446b-b2de-326524afc5fb] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:01.566753 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cae49fde-9ec0-4e0a-b72a-ed0f580c5b89 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:01.567200 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cae49fde-9ec0-4e0a-b72a-ed0f580c5b89 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:01.568111 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cae49fde-9ec0-4e0a-b72a-ed0f580c5b89 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:01.568549 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cae49fde-9ec0-4e0a-b72a-ed0f580c5b89 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:01.638328 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-7fb5bbc4-ae24-4dac-a3b3-079554b5090c req-a3004eeb-3900-43d5-af80-3b3b423b7e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f4875c-4f92-4b9e-8a76-8d80a51f293c", "name": "network-vif-deleted", "tag": "aa90b4eb-cda8-4006-b093-bbfc35e3c0c7"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:05:01.640503 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:05:01.640503 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:05:01.647790 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-7fb5bbc4-ae24-4dac-a3b3-079554b5090c req-a3004eeb-3900-43d5-af80-3b3b423b7e15 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:01.653563 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-7fb5bbc4-ae24-4dac-a3b3-079554b5090c req-a3004eeb-3900-43d5-af80-3b3b423b7e15 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:01.661072 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-7fb5bbc4-ae24-4dac-a3b3-079554b5090c req-a3004eeb-3900-43d5-af80-3b3b423b7e15 service nova] Creating event network-vif-deleted:aa90b4eb-cda8-4006-b093-bbfc35e3c0c7 for instance 25f4875c-4f92-4b9e-8a76-8d80a51f293c on hv-cinder-82276 Feb 04 18:05:01.666512 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-7fb5bbc4-ae24-4dac-a3b3-079554b5090c req-a3004eeb-3900-43d5-af80-3b3b423b7e15 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031650 Feb 04 18:05:01.667745 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 289/572] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:05:01.944948 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-cae49fde-9ec0-4e0a-b72a-ed0f580c5b89 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:01.953051 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-cae49fde-9ec0-4e0a-b72a-ed0f580c5b89 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb" status: 200 len: 1313 microversion: 2.1 time: 0.398401 Feb 04 18:05:01.953622 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 284/573] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:01 2022] GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:01.973412 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-abdfc82d-2537-49be-879d-09238c958fb7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:01.974143 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-abdfc82d-2537-49be-879d-09238c958fb7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:01.976759 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-239ebe20-5aaf-4c45-ab9e-4deee5b1a99d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:01.977367 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-239ebe20-5aaf-4c45-ab9e-4deee5b1a99d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:01.980889 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-abdfc82d-2537-49be-879d-09238c958fb7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:01.981345 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-abdfc82d-2537-49be-879d-09238c958fb7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:01.982135 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-abdfc82d-2537-49be-879d-09238c958fb7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:01.982613 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-abdfc82d-2537-49be-879d-09238c958fb7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:01.983341 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-239ebe20-5aaf-4c45-ab9e-4deee5b1a99d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:01.983800 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-239ebe20-5aaf-4c45-ab9e-4deee5b1a99d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:01.984584 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-239ebe20-5aaf-4c45-ab9e-4deee5b1a99d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:01.985026 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-239ebe20-5aaf-4c45-ab9e-4deee5b1a99d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:02.024061 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-abdfc82d-2537-49be-879d-09238c958fb7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:02.024761 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-abdfc82d-2537-49be-879d-09238c958fb7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:02.025214 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.objects.instance [None req-abdfc82d-2537-49be-879d-09238c958fb7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lazy-loading 'fault' on Instance uuid 25f4875c-4f92-4b9e-8a76-8d80a51f293c {{(pid=123566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:05:02.078448 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-abdfc82d-2537-49be-879d-09238c958fb7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:02.085865 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-abdfc82d-2537-49be-879d-09238c958fb7 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 200 len: 1307 microversion: 2.1 time: 0.116389 Feb 04 18:05:02.089138 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 290/574] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:01 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 1307 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:02.148344 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-239ebe20-5aaf-4c45-ab9e-4deee5b1a99d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:02.154812 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-239ebe20-5aaf-4c45-ab9e-4deee5b1a99d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.181833 Feb 04 18:05:02.155378 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 285/575] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:01 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:05:02.969749 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-0a1fad05-c295-4256-8847-1269a30b72a4 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:02.970362 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-0a1fad05-c295-4256-8847-1269a30b72a4 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 680d8d06-f576-446b-b2de-326524afc5fb] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:02.976300 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0a1fad05-c295-4256-8847-1269a30b72a4 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:02.976865 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0a1fad05-c295-4256-8847-1269a30b72a4 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:02.977516 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0a1fad05-c295-4256-8847-1269a30b72a4 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:02.977954 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0a1fad05-c295-4256-8847-1269a30b72a4 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:03.102384 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-74904bda-1153-47c5-8d64-ec2733a96d61 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:03.103162 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-74904bda-1153-47c5-8d64-ec2733a96d61 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 25f4875c-4f92-4b9e-8a76-8d80a51f293c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:03.110125 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-74904bda-1153-47c5-8d64-ec2733a96d61 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:03.110754 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-74904bda-1153-47c5-8d64-ec2733a96d61 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:03.111628 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-74904bda-1153-47c5-8d64-ec2733a96d61 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:03.112129 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-74904bda-1153-47c5-8d64-ec2733a96d61 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:03.115748 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-0a1fad05-c295-4256-8847-1269a30b72a4 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:03.127391 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-0a1fad05-c295-4256-8847-1269a30b72a4 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb" status: 200 len: 1313 microversion: 2.1 time: 0.157567 Feb 04 18:05:03.127391 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 291/576] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:02 2022] GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:03.127675 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.wsgi [None req-74904bda-1153-47c5-8d64-ec2733a96d61 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] HTTP exception thrown: Instance 25f4875c-4f92-4b9e-8a76-8d80a51f293c could not be found. Feb 04 18:05:03.127675 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-74904bda-1153-47c5-8d64-ec2733a96d61 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Returning 404 to user: Instance 25f4875c-4f92-4b9e-8a76-8d80a51f293c could not be found. {{(pid=123567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:05:03.128082 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-74904bda-1153-47c5-8d64-ec2733a96d61 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c" status: 404 len: 111 microversion: 2.1 time: 0.029542 Feb 04 18:05:03.128624 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 286/577] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:03 2022] GET /compute/v2.1/servers/25f4875c-4f92-4b9e-8a76-8d80a51f293c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:05:03.136165 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-6cd66ec9-631e-47b4-ac6e-1829cfcae3f4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:03.136652 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-6cd66ec9-631e-47b4-ac6e-1829cfcae3f4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:03.142939 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6cd66ec9-631e-47b4-ac6e-1829cfcae3f4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:03.143384 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6cd66ec9-631e-47b4-ac6e-1829cfcae3f4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:03.144166 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6cd66ec9-631e-47b4-ac6e-1829cfcae3f4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:03.144593 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6cd66ec9-631e-47b4-ac6e-1829cfcae3f4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:03.170470 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-6cd66ec9-631e-47b4-ac6e-1829cfcae3f4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Going to try to terminate instance {{(pid=123566) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 04 18:05:03.171220 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-7bf05123-0fa0-475d-ae3d-608bf473d078 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:03.171787 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-7bf05123-0fa0-475d-ae3d-608bf473d078 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:03.177593 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7bf05123-0fa0-475d-ae3d-608bf473d078 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:03.178046 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7bf05123-0fa0-475d-ae3d-608bf473d078 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:03.179051 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7bf05123-0fa0-475d-ae3d-608bf473d078 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:03.179493 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7bf05123-0fa0-475d-ae3d-608bf473d078 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:03.312598 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-7bf05123-0fa0-475d-ae3d-608bf473d078 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:03.319814 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-7bf05123-0fa0-475d-ae3d-608bf473d078 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.153131 Feb 04 18:05:03.320371 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 287/578] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:03 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:05:03.439451 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-6cd66ec9-631e-47b4-ac6e-1829cfcae3f4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "DELETE /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 204 len: 0 microversion: 2.1 time: 0.306434 Feb 04 18:05:03.439970 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 292/579] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Feb 4 18:05:03 2022] DELETE /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 04 18:05:03.447907 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-0ea78fd1-1785-4309-ad82-3bfd2200df6f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:03.448615 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-0ea78fd1-1785-4309-ad82-3bfd2200df6f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:03.454567 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0ea78fd1-1785-4309-ad82-3bfd2200df6f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:03.456149 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0ea78fd1-1785-4309-ad82-3bfd2200df6f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:03.456149 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0ea78fd1-1785-4309-ad82-3bfd2200df6f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:03.456331 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0ea78fd1-1785-4309-ad82-3bfd2200df6f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:03.589703 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-0ea78fd1-1785-4309-ad82-3bfd2200df6f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:03.597571 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-0ea78fd1-1785-4309-ad82-3bfd2200df6f tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1514 microversion: 2.1 time: 0.153359 Feb 04 18:05:03.598141 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 288/580] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:03 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:04.141285 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-04df746d-6b43-4123-943c-df5a7f2555c0 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:04.142156 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-04df746d-6b43-4123-943c-df5a7f2555c0 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 680d8d06-f576-446b-b2de-326524afc5fb] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:04.150335 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-04df746d-6b43-4123-943c-df5a7f2555c0 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:04.150937 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-04df746d-6b43-4123-943c-df5a7f2555c0 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:04.151684 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-04df746d-6b43-4123-943c-df5a7f2555c0 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:04.152151 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-04df746d-6b43-4123-943c-df5a7f2555c0 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:04.285150 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-04df746d-6b43-4123-943c-df5a7f2555c0 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:04.292464 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-04df746d-6b43-4123-943c-df5a7f2555c0 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb" status: 200 len: 1495 microversion: 2.1 time: 0.155342 Feb 04 18:05:04.293242 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 293/581] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:04 2022] GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb => generated 1495 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:04.335773 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-7446f7e7-02ed-415b-a25e-8e85ae15cb57 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:04.336531 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-7446f7e7-02ed-415b-a25e-8e85ae15cb57 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:04.343576 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7446f7e7-02ed-415b-a25e-8e85ae15cb57 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:04.344028 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7446f7e7-02ed-415b-a25e-8e85ae15cb57 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:04.344816 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7446f7e7-02ed-415b-a25e-8e85ae15cb57 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:04.345255 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7446f7e7-02ed-415b-a25e-8e85ae15cb57 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:04.482798 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-7446f7e7-02ed-415b-a25e-8e85ae15cb57 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:04.490732 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-7446f7e7-02ed-415b-a25e-8e85ae15cb57 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.158757 Feb 04 18:05:04.491306 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 289/582] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:04 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:04.614091 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-c6223d14-8c94-4076-98d6-33aaf02c72e1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:04.614734 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-c6223d14-8c94-4076-98d6-33aaf02c72e1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:04.621124 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c6223d14-8c94-4076-98d6-33aaf02c72e1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:04.621571 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c6223d14-8c94-4076-98d6-33aaf02c72e1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:04.622351 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c6223d14-8c94-4076-98d6-33aaf02c72e1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:04.622826 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c6223d14-8c94-4076-98d6-33aaf02c72e1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:04.756150 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c6223d14-8c94-4076-98d6-33aaf02c72e1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:04.763527 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-c6223d14-8c94-4076-98d6-33aaf02c72e1 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1514 microversion: 2.1 time: 0.153097 Feb 04 18:05:04.764936 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 294/583] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:04 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:05.398730 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3d19efe0-12a5-4e08-bc6a-c890b4101dd7 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:05.399214 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-3d19efe0-12a5-4e08-bc6a-c890b4101dd7 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 680d8d06-f576-446b-b2de-326524afc5fb] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:05.405484 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3d19efe0-12a5-4e08-bc6a-c890b4101dd7 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:05.405931 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3d19efe0-12a5-4e08-bc6a-c890b4101dd7 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:05.406724 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3d19efe0-12a5-4e08-bc6a-c890b4101dd7 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:05.407158 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3d19efe0-12a5-4e08-bc6a-c890b4101dd7 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:05.431223 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-3d19efe0-12a5-4e08-bc6a-c890b4101dd7 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 680d8d06-f576-446b-b2de-326524afc5fb] Going to try to terminate instance {{(pid=123567) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 04 18:05:05.507510 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-0798e406-b82d-417e-b937-449fd3b6f98d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:05.515190 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-0798e406-b82d-417e-b937-449fd3b6f98d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:05.515190 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0798e406-b82d-417e-b937-449fd3b6f98d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:05.515483 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0798e406-b82d-417e-b937-449fd3b6f98d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:05.516275 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0798e406-b82d-417e-b937-449fd3b6f98d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:05.516762 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0798e406-b82d-417e-b937-449fd3b6f98d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:05.653110 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-0798e406-b82d-417e-b937-449fd3b6f98d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:05.660897 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-0798e406-b82d-417e-b937-449fd3b6f98d tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1522 microversion: 2.1 time: 0.157002 Feb 04 18:05:05.670394 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 295/584] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:05 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:05:05.736670 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-3d19efe0-12a5-4e08-bc6a-c890b4101dd7 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "DELETE /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb" status: 204 len: 0 microversion: 2.1 time: 0.341268 Feb 04 18:05:05.737202 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 290/585] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Feb 4 18:05:05 2022] DELETE /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 04 18:05:05.745525 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ceb26f5c-c559-418e-91a6-ead28ce21461 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:05.746286 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ceb26f5c-c559-418e-91a6-ead28ce21461 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 680d8d06-f576-446b-b2de-326524afc5fb] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:05.752786 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ceb26f5c-c559-418e-91a6-ead28ce21461 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:05.753471 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ceb26f5c-c559-418e-91a6-ead28ce21461 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:05.754473 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ceb26f5c-c559-418e-91a6-ead28ce21461 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:05.755219 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ceb26f5c-c559-418e-91a6-ead28ce21461 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:05.782028 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-4648eb62-ae9a-4927-863e-eca3710d8cc4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:05.782957 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-4648eb62-ae9a-4927-863e-eca3710d8cc4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:05.789126 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4648eb62-ae9a-4927-863e-eca3710d8cc4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:05.789671 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4648eb62-ae9a-4927-863e-eca3710d8cc4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:05.790555 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4648eb62-ae9a-4927-863e-eca3710d8cc4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:05.791218 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4648eb62-ae9a-4927-863e-eca3710d8cc4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:05.928291 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-ceb26f5c-c559-418e-91a6-ead28ce21461 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:05.935961 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ceb26f5c-c559-418e-91a6-ead28ce21461 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb" status: 200 len: 1501 microversion: 2.1 time: 0.194194 Feb 04 18:05:05.937189 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 296/586] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:05 2022] GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb => generated 1501 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:05.941892 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-640a2f98-2edb-4457-b2d6-3d47ac7ed250 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "637c3cf6-09de-4d6b-bec1-ea8cf0f91427", "device": "/dev/sdb"}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:05:05.944589 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-640a2f98-2edb-4457-b2d6-3d47ac7ed250 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:05.951528 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-640a2f98-2edb-4457-b2d6-3d47ac7ed250 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:05.952652 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-640a2f98-2edb-4457-b2d6-3d47ac7ed250 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:05.954588 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-640a2f98-2edb-4457-b2d6-3d47ac7ed250 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:05.954588 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-640a2f98-2edb-4457-b2d6-3d47ac7ed250 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:05.986979 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-4648eb62-ae9a-4927-863e-eca3710d8cc4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:06.004988 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-4648eb62-ae9a-4927-863e-eca3710d8cc4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1514 microversion: 2.1 time: 0.224721 Feb 04 18:05:06.005943 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 291/587] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:05 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1514 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:06.053569 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-984bfb74-1af2-4095-a66e-b6b94b4cc360 req-2918756c-e167-4445-bae4-682094494ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b81832-5021-4cd2-8ebf-767daeb17673", "name": "network-vif-deleted", "tag": "448b92cf-8fd6-4137-a431-b26132b3bd03"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:05:06.055242 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:05:06.055242 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:05:06.063856 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-984bfb74-1af2-4095-a66e-b6b94b4cc360 req-2918756c-e167-4445-bae4-682094494ddf service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:06.064312 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-984bfb74-1af2-4095-a66e-b6b94b4cc360 req-2918756c-e167-4445-bae4-682094494ddf service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:06.077510 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-984bfb74-1af2-4095-a66e-b6b94b4cc360 req-2918756c-e167-4445-bae4-682094494ddf service nova] Creating event network-vif-deleted:448b92cf-8fd6-4137-a431-b26132b3bd03 for instance 16b81832-5021-4cd2-8ebf-767daeb17673 on hv-cinder-82276 Feb 04 18:05:06.085093 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-984bfb74-1af2-4095-a66e-b6b94b4cc360 req-2918756c-e167-4445-bae4-682094494ddf service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032291 Feb 04 18:05:06.085093 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 292/588] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:05:06.677615 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-78ddab39-a07c-4618-8154-674b8ec61dcf tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:06.678318 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-78ddab39-a07c-4618-8154-674b8ec61dcf tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:06.684906 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-78ddab39-a07c-4618-8154-674b8ec61dcf tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:06.685365 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-78ddab39-a07c-4618-8154-674b8ec61dcf tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:06.686724 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-78ddab39-a07c-4618-8154-674b8ec61dcf tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:06.687174 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-78ddab39-a07c-4618-8154-674b8ec61dcf tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:06.717518 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-78ddab39-a07c-4618-8154-674b8ec61dcf tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:06.718013 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-78ddab39-a07c-4618-8154-674b8ec61dcf tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:06.718497 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.objects.instance [None req-78ddab39-a07c-4618-8154-674b8ec61dcf tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lazy-loading 'fault' on Instance uuid 16b81832-5021-4cd2-8ebf-767daeb17673 {{(pid=123567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:05:06.764418 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-78ddab39-a07c-4618-8154-674b8ec61dcf tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851ffad2aa464fca8861b9735217a039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f3b231bd8d4b4ead414b5d72ec8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:06.769977 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-78ddab39-a07c-4618-8154-674b8ec61dcf tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 200 len: 1312 microversion: 2.1 time: 0.096393 Feb 04 18:05:06.770784 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 293/589] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:06 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:05:06.796327 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-640a2f98-2edb-4457-b2d6-3d47ac7ed250 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "POST /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.857310 Feb 04 18:05:06.796957 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 297/590] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Feb 4 18:05:05 2022] POST /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e/os-volume_attachments => generated 194 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:05:06.952923 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-f7ea696d-2f44-4c81-8875-ca917fec04ac tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:06.953452 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-f7ea696d-2f44-4c81-8875-ca917fec04ac tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 680d8d06-f576-446b-b2de-326524afc5fb] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:06.959684 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f7ea696d-2f44-4c81-8875-ca917fec04ac tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:06.960133 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f7ea696d-2f44-4c81-8875-ca917fec04ac tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:06.960916 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f7ea696d-2f44-4c81-8875-ca917fec04ac tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:06.961355 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f7ea696d-2f44-4c81-8875-ca917fec04ac tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:07.021804 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-166434a6-7f3e-4cf4-881e-5ada2bd29ca9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:07.025248 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-166434a6-7f3e-4cf4-881e-5ada2bd29ca9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:07.029378 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-166434a6-7f3e-4cf4-881e-5ada2bd29ca9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:07.029834 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-166434a6-7f3e-4cf4-881e-5ada2bd29ca9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:07.030750 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-166434a6-7f3e-4cf4-881e-5ada2bd29ca9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:07.031192 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-166434a6-7f3e-4cf4-881e-5ada2bd29ca9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:07.107769 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-166434a6-7f3e-4cf4-881e-5ada2bd29ca9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:07.119245 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-166434a6-7f3e-4cf4-881e-5ada2bd29ca9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1472 microversion: 2.1 time: 0.101835 Feb 04 18:05:07.126233 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 298/591] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:07 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1472 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:05:07.137718 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-f7ea696d-2f44-4c81-8875-ca917fec04ac tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:07.150693 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-f7ea696d-2f44-4c81-8875-ca917fec04ac tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb" status: 200 len: 1501 microversion: 2.1 time: 0.198957 Feb 04 18:05:07.150693 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 294/592] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:06 2022] GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb => generated 1501 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:07.786715 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-18663db9-5585-4a1c-8a8e-47e33b03ba31 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:07.787251 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-18663db9-5585-4a1c-8a8e-47e33b03ba31 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] [instance: 16b81832-5021-4cd2-8ebf-767daeb17673] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:07.793510 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-18663db9-5585-4a1c-8a8e-47e33b03ba31 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:07.793958 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-18663db9-5585-4a1c-8a8e-47e33b03ba31 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:07.794771 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-18663db9-5585-4a1c-8a8e-47e33b03ba31 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:07.795201 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-18663db9-5585-4a1c-8a8e-47e33b03ba31 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:07.809161 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-18663db9-5585-4a1c-8a8e-47e33b03ba31 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] HTTP exception thrown: Instance 16b81832-5021-4cd2-8ebf-767daeb17673 could not be found. Feb 04 18:05:07.810163 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-18663db9-5585-4a1c-8a8e-47e33b03ba31 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] Returning 404 to user: Instance 16b81832-5021-4cd2-8ebf-767daeb17673 could not be found. {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:05:07.815358 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-18663db9-5585-4a1c-8a8e-47e33b03ba31 tempest-ServerRescueNegativeTestJSON-1706624928 tempest-ServerRescueNegativeTestJSON-1706624928-project] 10.222.0.98 "GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673" status: 404 len: 111 microversion: 2.1 time: 0.027702 Feb 04 18:05:07.815358 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 299/593] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:07 2022] GET /compute/v2.1/servers/16b81832-5021-4cd2-8ebf-767daeb17673 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:05:08.097081 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-7801136d-6c3b-4e13-aa81-3b782e73340d req-4c26b2ac-9d55-4cf8-8f5a-0cc502534422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11825ca5-07bd-404f-8133-569adcfb9de0", "name": "network-vif-deleted", "tag": "d402aa33-a7fe-42e3-b2c8-eb33d0501272"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:05:08.098764 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:05:08.098764 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:05:08.107064 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-7801136d-6c3b-4e13-aa81-3b782e73340d req-4c26b2ac-9d55-4cf8-8f5a-0cc502534422 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:08.107821 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-7801136d-6c3b-4e13-aa81-3b782e73340d req-4c26b2ac-9d55-4cf8-8f5a-0cc502534422 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:08.121496 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-7801136d-6c3b-4e13-aa81-3b782e73340d req-4c26b2ac-9d55-4cf8-8f5a-0cc502534422 service nova] Creating event network-vif-deleted:d402aa33-a7fe-42e3-b2c8-eb33d0501272 for instance 11825ca5-07bd-404f-8133-569adcfb9de0 on hv-cinder-82276 Feb 04 18:05:08.127504 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-7801136d-6c3b-4e13-aa81-3b782e73340d req-4c26b2ac-9d55-4cf8-8f5a-0cc502534422 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033878 Feb 04 18:05:08.128444 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 295/594] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:05:08.141521 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-456b833e-0a45-42b4-889e-b3cc80283758 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:08.146244 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-456b833e-0a45-42b4-889e-b3cc80283758 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:08.150714 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-456b833e-0a45-42b4-889e-b3cc80283758 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:08.151427 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-456b833e-0a45-42b4-889e-b3cc80283758 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:08.152419 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-456b833e-0a45-42b4-889e-b3cc80283758 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:08.153051 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-456b833e-0a45-42b4-889e-b3cc80283758 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:08.165303 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-fd389e9e-f014-4802-a504-16c317bee70d tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:08.166011 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-fd389e9e-f014-4802-a504-16c317bee70d tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 680d8d06-f576-446b-b2de-326524afc5fb] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:08.199265 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-456b833e-0a45-42b4-889e-b3cc80283758 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:08.200095 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-456b833e-0a45-42b4-889e-b3cc80283758 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:08.200741 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.objects.instance [None req-456b833e-0a45-42b4-889e-b3cc80283758 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lazy-loading 'fault' on Instance uuid 11825ca5-07bd-404f-8133-569adcfb9de0 {{(pid=123566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:05:08.204725 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fd389e9e-f014-4802-a504-16c317bee70d tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:08.205352 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fd389e9e-f014-4802-a504-16c317bee70d tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:08.206448 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fd389e9e-f014-4802-a504-16c317bee70d tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:08.206897 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fd389e9e-f014-4802-a504-16c317bee70d tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:08.298378 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-456b833e-0a45-42b4-889e-b3cc80283758 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:08.305969 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-456b833e-0a45-42b4-889e-b3cc80283758 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 200 len: 1308 microversion: 2.1 time: 0.168765 Feb 04 18:05:08.306609 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 300/595] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:08 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 1308 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:08.329523 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-a9f969fd-4f8e-4f70-adc6-51bbd8639267 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:05:08.329523 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-a9f969fd-4f8e-4f70-adc6-51bbd8639267 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:08.332590 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a9f969fd-4f8e-4f70-adc6-51bbd8639267 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:08.333073 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a9f969fd-4f8e-4f70-adc6-51bbd8639267 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:08.334566 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a9f969fd-4f8e-4f70-adc6-51bbd8639267 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:08.334566 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a9f969fd-4f8e-4f70-adc6-51bbd8639267 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:08.359678 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.objects.instance [None req-a9f969fd-4f8e-4f70-adc6-51bbd8639267 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lazy-loading 'flavor' on Instance uuid 514ca883-72d2-4695-a4b6-47c18ce4add5 {{(pid=123566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:05:08.495521 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-fd389e9e-f014-4802-a504-16c317bee70d tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:08.503651 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-fd389e9e-f014-4802-a504-16c317bee70d tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb" status: 200 len: 1501 microversion: 2.1 time: 0.342198 Feb 04 18:05:08.504243 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 296/596] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:08 2022] GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb => generated 1501 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:05:09.012866 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-a9f969fd-4f8e-4f70-adc6-51bbd8639267 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "POST /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5/action" status: 202 len: 0 microversion: 2.20 time: 0.695627 Feb 04 18:05:09.014166 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 301/597] 10.222.0.98 () {62 vars in 1318 bytes} [Fri Feb 4 18:05:08 2022] POST /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5/action => generated 0 bytes in 707 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 04 18:05:09.022933 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-1a939771-3f65-4427-b571-aab1e7c1ebdb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:09.023555 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-1a939771-3f65-4427-b571-aab1e7c1ebdb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:09.030230 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1a939771-3f65-4427-b571-aab1e7c1ebdb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:09.030731 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1a939771-3f65-4427-b571-aab1e7c1ebdb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:09.031535 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1a939771-3f65-4427-b571-aab1e7c1ebdb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:09.032027 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1a939771-3f65-4427-b571-aab1e7c1ebdb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:09.189445 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-1a939771-3f65-4427-b571-aab1e7c1ebdb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:09.199972 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-1a939771-3f65-4427-b571-aab1e7c1ebdb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:09.201572 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-1a939771-3f65-4427-b571-aab1e7c1ebdb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:09.202948 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-1a939771-3f65-4427-b571-aab1e7c1ebdb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1721 microversion: 2.20 time: 0.184387 Feb 04 18:05:09.203509 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 297/598] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:09 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:05:09.323870 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-d95d1b5e-2e4d-4367-8536-c4259f76f9d3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:09.324564 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-d95d1b5e-2e4d-4367-8536-c4259f76f9d3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: 11825ca5-07bd-404f-8133-569adcfb9de0] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:09.332469 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d95d1b5e-2e4d-4367-8536-c4259f76f9d3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:09.333808 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d95d1b5e-2e4d-4367-8536-c4259f76f9d3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:09.333941 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d95d1b5e-2e4d-4367-8536-c4259f76f9d3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:09.334611 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d95d1b5e-2e4d-4367-8536-c4259f76f9d3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:09.350620 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-d95d1b5e-2e4d-4367-8536-c4259f76f9d3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] HTTP exception thrown: Instance 11825ca5-07bd-404f-8133-569adcfb9de0 could not be found. Feb 04 18:05:09.351224 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-d95d1b5e-2e4d-4367-8536-c4259f76f9d3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Returning 404 to user: Instance 11825ca5-07bd-404f-8133-569adcfb9de0 could not be found. {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:05:09.352107 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-d95d1b5e-2e4d-4367-8536-c4259f76f9d3 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0" status: 404 len: 111 microversion: 2.1 time: 0.032434 Feb 04 18:05:09.357192 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 302/599] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:09 2022] GET /compute/v2.1/servers/11825ca5-07bd-404f-8133-569adcfb9de0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:05:09.525564 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-72f07137-99ea-4835-9673-19edea136958 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:09.529431 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-72f07137-99ea-4835-9673-19edea136958 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 680d8d06-f576-446b-b2de-326524afc5fb] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:09.537550 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-72f07137-99ea-4835-9673-19edea136958 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:09.538317 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-72f07137-99ea-4835-9673-19edea136958 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:09.539225 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-72f07137-99ea-4835-9673-19edea136958 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:09.539658 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-72f07137-99ea-4835-9673-19edea136958 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:09.577008 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-72f07137-99ea-4835-9673-19edea136958 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:09.578153 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-72f07137-99ea-4835-9673-19edea136958 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:09.579185 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.objects.instance [None req-72f07137-99ea-4835-9673-19edea136958 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lazy-loading 'fault' on Instance uuid 680d8d06-f576-446b-b2de-326524afc5fb {{(pid=123567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:05:09.636588 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-72f07137-99ea-4835-9673-19edea136958 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:09.644565 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-72f07137-99ea-4835-9673-19edea136958 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb" status: 200 len: 1303 microversion: 2.1 time: 0.127612 Feb 04 18:05:09.645450 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 298/600] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:09 2022] GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb => generated 1303 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:10.150460 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-a3599e64-904e-4a97-88e2-4bc5eb6154ff req-1c73a1c6-3c61-483d-b84b-968c23b1e5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "680d8d06-f576-446b-b2de-326524afc5fb", "name": "network-vif-deleted", "tag": "7a82baa8-3397-462f-b2ef-4e1a91ad73ef"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:05:10.153170 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:05:10.153170 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:05:10.169931 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-a3599e64-904e-4a97-88e2-4bc5eb6154ff req-1c73a1c6-3c61-483d-b84b-968c23b1e5b0 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:10.170778 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-a3599e64-904e-4a97-88e2-4bc5eb6154ff req-1c73a1c6-3c61-483d-b84b-968c23b1e5b0 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:10.195134 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-a3599e64-904e-4a97-88e2-4bc5eb6154ff req-1c73a1c6-3c61-483d-b84b-968c23b1e5b0 service nova] Creating event network-vif-deleted:7a82baa8-3397-462f-b2ef-4e1a91ad73ef for instance 680d8d06-f576-446b-b2de-326524afc5fb on hv-cinder-82276 Feb 04 18:05:10.200212 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-a3599e64-904e-4a97-88e2-4bc5eb6154ff req-1c73a1c6-3c61-483d-b84b-968c23b1e5b0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057048 Feb 04 18:05:10.200818 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 303/601] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:05:10.221095 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-159ed699-c135-4deb-9c0b-ebfcd81bb116 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:10.223506 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-159ed699-c135-4deb-9c0b-ebfcd81bb116 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:10.228581 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-159ed699-c135-4deb-9c0b-ebfcd81bb116 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:10.228981 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-159ed699-c135-4deb-9c0b-ebfcd81bb116 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:10.229802 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-159ed699-c135-4deb-9c0b-ebfcd81bb116 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:10.230252 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-159ed699-c135-4deb-9c0b-ebfcd81bb116 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:10.479021 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-159ed699-c135-4deb-9c0b-ebfcd81bb116 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:10.494011 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-159ed699-c135-4deb-9c0b-ebfcd81bb116 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:10.497008 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-159ed699-c135-4deb-9c0b-ebfcd81bb116 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:10.499779 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-159ed699-c135-4deb-9c0b-ebfcd81bb116 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1721 microversion: 2.20 time: 0.281662 Feb 04 18:05:10.500827 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 299/602] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:10 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1721 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:05:10.668061 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-4d2f2c9c-ee17-46e3-bf19-a64419247303 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:10.668692 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-4d2f2c9c-ee17-46e3-bf19-a64419247303 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 680d8d06-f576-446b-b2de-326524afc5fb] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:10.669684 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-875d2217-7a3f-418f-8c51-e442dfc7e9e4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:10.670309 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-875d2217-7a3f-418f-8c51-e442dfc7e9e4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:10.680223 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-875d2217-7a3f-418f-8c51-e442dfc7e9e4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:10.682850 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-875d2217-7a3f-418f-8c51-e442dfc7e9e4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:10.683674 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-875d2217-7a3f-418f-8c51-e442dfc7e9e4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:10.684120 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-875d2217-7a3f-418f-8c51-e442dfc7e9e4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:10.691602 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4d2f2c9c-ee17-46e3-bf19-a64419247303 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:10.692063 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4d2f2c9c-ee17-46e3-bf19-a64419247303 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:10.692872 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4d2f2c9c-ee17-46e3-bf19-a64419247303 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:10.693316 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4d2f2c9c-ee17-46e3-bf19-a64419247303 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:10.719590 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.wsgi [None req-4d2f2c9c-ee17-46e3-bf19-a64419247303 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] HTTP exception thrown: Instance 680d8d06-f576-446b-b2de-326524afc5fb could not be found. Feb 04 18:05:10.720135 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-4d2f2c9c-ee17-46e3-bf19-a64419247303 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Returning 404 to user: Instance 680d8d06-f576-446b-b2de-326524afc5fb could not be found. {{(pid=123567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:05:10.720979 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-4d2f2c9c-ee17-46e3-bf19-a64419247303 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb" status: 404 len: 111 microversion: 2.1 time: 0.062637 Feb 04 18:05:10.731431 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 300/603] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:10 2022] GET /compute/v2.1/servers/680d8d06-f576-446b-b2de-326524afc5fb => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:05:10.745987 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-875d2217-7a3f-418f-8c51-e442dfc7e9e4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Going to try to terminate instance {{(pid=123566) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 04 18:05:10.791376 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b1bd437b-6bfa-4f01-b7d5-c36884a2bedd tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-95070616", "imageRef": "b0fb57f5-967d-4692-94f3-accee37910c3", "flavorRef": "452", "networks": [{"uuid": "3c8f4dc8-6fb2-4000-b5a7-88685daca3d0"}]}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:05:10.842559 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.network.neutron [None req-b1bd437b-6bfa-4f01-b7d5-c36884a2bedd tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] validate_networks() for [('3c8f4dc8-6fb2-4000-b5a7-88685daca3d0', None, None, None, None, None)] {{(pid=123567) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 04 18:05:11.193950 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-875d2217-7a3f-418f-8c51-e442dfc7e9e4 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "DELETE /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 204 len: 0 microversion: 2.1 time: 0.537100 Feb 04 18:05:11.194680 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 304/604] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Feb 4 18:05:10 2022] DELETE /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 04 18:05:11.203613 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-0ef192eb-755f-4c3e-a660-99590c725582 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:11.204385 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-0ef192eb-755f-4c3e-a660-99590c725582 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:11.212550 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0ef192eb-755f-4c3e-a660-99590c725582 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:11.213736 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0ef192eb-755f-4c3e-a660-99590c725582 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:11.214554 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0ef192eb-755f-4c3e-a660-99590c725582 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:11.214991 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0ef192eb-755f-4c3e-a660-99590c725582 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:11.502955 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-b1bd437b-6bfa-4f01-b7d5-c36884a2bedd tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Flavor limits 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 04 18:05:11.503442 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-b1bd437b-6bfa-4f01-b7d5-c36884a2bedd tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Image limits 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 04 18:05:11.503960 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-b1bd437b-6bfa-4f01-b7d5-c36884a2bedd tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Flavor pref 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 04 18:05:11.504456 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-b1bd437b-6bfa-4f01-b7d5-c36884a2bedd tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Image pref 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 04 18:05:11.505113 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-b1bd437b-6bfa-4f01-b7d5-c36884a2bedd tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 04 18:05:11.515759 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b1bd437b-6bfa-4f01-b7d5-c36884a2bedd tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:11.516356 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b1bd437b-6bfa-4f01-b7d5-c36884a2bedd tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:11.517360 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b1bd437b-6bfa-4f01-b7d5-c36884a2bedd tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:11.518111 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b1bd437b-6bfa-4f01-b7d5-c36884a2bedd tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:11.540284 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-b1bd437b-6bfa-4f01-b7d5-c36884a2bedd tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Getting quotas for project d702ff83402e4a79b37f95a3fc6775a3. Resources: {'cores', 'ram', 'instances'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:05:11.545227 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-b1bd437b-6bfa-4f01-b7d5-c36884a2bedd tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Getting quotas for user 6414e43a723f47eea81f71706d1a8cdd and project d702ff83402e4a79b37f95a3fc6775a3. Resources: {'cores', 'ram', 'instances'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:05:11.549457 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-0ef192eb-755f-4c3e-a660-99590c725582 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:11.557563 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-0ef192eb-755f-4c3e-a660-99590c725582 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1514 microversion: 2.1 time: 0.358466 Feb 04 18:05:11.558562 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-b1bd437b-6bfa-4f01-b7d5-c36884a2bedd tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Going to run 1 instances... {{(pid=123567) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 04 18:05:11.559504 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 305/605] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:11 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1514 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:05:11.561187 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-b1bd437b-6bfa-4f01-b7d5-c36884a2bedd tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0fb57f5-967d-4692-94f3-accee37910c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 04 18:05:11.565005 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-f5d03172-867e-4ae3-b941-4499c09e93da tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:11.565723 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-f5d03172-867e-4ae3-b941-4499c09e93da tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:11.572008 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f5d03172-867e-4ae3-b941-4499c09e93da tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:11.572771 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f5d03172-867e-4ae3-b941-4499c09e93da tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:11.573636 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f5d03172-867e-4ae3-b941-4499c09e93da tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:11.574199 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f5d03172-867e-4ae3-b941-4499c09e93da tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:11.687293 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b1bd437b-6bfa-4f01-b7d5-c36884a2bedd tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.898960 Feb 04 18:05:11.688634 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 301/606] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Feb 4 18:05:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 04 18:05:11.698575 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-ce69c189-b4c8-4209-acc3-a5ef8acbcea6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:11.699187 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-ce69c189-b4c8-4209-acc3-a5ef8acbcea6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:11.790010 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ce69c189-b4c8-4209-acc3-a5ef8acbcea6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:11.800084 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-ce69c189-b4c8-4209-acc3-a5ef8acbcea6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1212 microversion: 2.1 time: 0.105543 Feb 04 18:05:11.812018 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 302/607] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:11 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1212 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:05:11.852185 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-f5d03172-867e-4ae3-b941-4499c09e93da tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:11.861610 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-f5d03172-867e-4ae3-b941-4499c09e93da tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:11.863182 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-f5d03172-867e-4ae3-b941-4499c09e93da tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:11.866734 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-f5d03172-867e-4ae3-b941-4499c09e93da tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1721 microversion: 2.20 time: 0.303774 Feb 04 18:05:11.870581 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 306/608] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:11 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1721 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:05:12.576616 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-5512786b-70d9-4000-8dfe-851ad142f7a9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:12.577904 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-5512786b-70d9-4000-8dfe-851ad142f7a9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:12.586698 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5512786b-70d9-4000-8dfe-851ad142f7a9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:12.587162 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5512786b-70d9-4000-8dfe-851ad142f7a9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:12.587954 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5512786b-70d9-4000-8dfe-851ad142f7a9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:12.588395 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5512786b-70d9-4000-8dfe-851ad142f7a9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:12.728431 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5512786b-70d9-4000-8dfe-851ad142f7a9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:12.736378 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-5512786b-70d9-4000-8dfe-851ad142f7a9 tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1514 microversion: 2.1 time: 0.163618 Feb 04 18:05:12.736946 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 303/609] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:12 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:12.816720 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-a8679b4e-de14-40b9-aead-49fd12d8ab83 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:12.817302 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-a8679b4e-de14-40b9-aead-49fd12d8ab83 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:12.823695 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a8679b4e-de14-40b9-aead-49fd12d8ab83 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:12.824214 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a8679b4e-de14-40b9-aead-49fd12d8ab83 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:12.824985 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a8679b4e-de14-40b9-aead-49fd12d8ab83 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:12.825425 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a8679b4e-de14-40b9-aead-49fd12d8ab83 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:12.885024 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-a8679b4e-de14-40b9-aead-49fd12d8ab83 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:12.888562 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-9a1669bf-637d-4882-90a2-5e85796e74d6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:12.889197 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-9a1669bf-637d-4882-90a2-5e85796e74d6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:12.892505 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-a8679b4e-de14-40b9-aead-49fd12d8ab83 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1216 microversion: 2.1 time: 0.079566 Feb 04 18:05:12.893089 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 307/610] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:12 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1216 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:05:12.895148 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9a1669bf-637d-4882-90a2-5e85796e74d6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:12.895592 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9a1669bf-637d-4882-90a2-5e85796e74d6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:12.896369 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9a1669bf-637d-4882-90a2-5e85796e74d6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:12.896798 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9a1669bf-637d-4882-90a2-5e85796e74d6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:13.037683 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-9a1669bf-637d-4882-90a2-5e85796e74d6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:13.046916 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-9a1669bf-637d-4882-90a2-5e85796e74d6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:13.048812 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-9a1669bf-637d-4882-90a2-5e85796e74d6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:13.050093 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-9a1669bf-637d-4882-90a2-5e85796e74d6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1721 microversion: 2.20 time: 0.165329 Feb 04 18:05:13.050880 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 304/611] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:12 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:05:13.752629 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-9d2dded1-f49f-430c-93b2-e6b08831263d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:13.753238 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-9d2dded1-f49f-430c-93b2-e6b08831263d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:13.759098 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9d2dded1-f49f-430c-93b2-e6b08831263d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:13.759537 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9d2dded1-f49f-430c-93b2-e6b08831263d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:13.760581 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9d2dded1-f49f-430c-93b2-e6b08831263d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:13.761082 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9d2dded1-f49f-430c-93b2-e6b08831263d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:13.911115 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-9d2dded1-f49f-430c-93b2-e6b08831263d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:13.911777 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-ede436d0-2440-43b2-a896-42aad1ac846f tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:13.912212 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-ede436d0-2440-43b2-a896-42aad1ac846f tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:13.919612 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ede436d0-2440-43b2-a896-42aad1ac846f tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:13.920398 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ede436d0-2440-43b2-a896-42aad1ac846f tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:13.921192 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-9d2dded1-f49f-430c-93b2-e6b08831263d tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1514 microversion: 2.1 time: 0.172021 Feb 04 18:05:13.921394 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ede436d0-2440-43b2-a896-42aad1ac846f tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:13.922331 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ede436d0-2440-43b2-a896-42aad1ac846f tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:13.931617 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 308/612] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:13 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:13.993329 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ede436d0-2440-43b2-a896-42aad1ac846f tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:14.002659 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-ede436d0-2440-43b2-a896-42aad1ac846f tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1264 microversion: 2.1 time: 0.096887 Feb 04 18:05:14.003699 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 305/613] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:13 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1264 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:14.068576 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-10d28fc6-39b9-4526-b6b1-b0d6fb0ba33a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:14.069227 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-10d28fc6-39b9-4526-b6b1-b0d6fb0ba33a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:14.075327 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-10d28fc6-39b9-4526-b6b1-b0d6fb0ba33a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:14.075778 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-10d28fc6-39b9-4526-b6b1-b0d6fb0ba33a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:14.076563 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-10d28fc6-39b9-4526-b6b1-b0d6fb0ba33a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:14.077004 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-10d28fc6-39b9-4526-b6b1-b0d6fb0ba33a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:14.296731 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-10d28fc6-39b9-4526-b6b1-b0d6fb0ba33a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:14.305236 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-10d28fc6-39b9-4526-b6b1-b0d6fb0ba33a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:14.306765 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-10d28fc6-39b9-4526-b6b1-b0d6fb0ba33a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:14.308039 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-10d28fc6-39b9-4526-b6b1-b0d6fb0ba33a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1721 microversion: 2.20 time: 0.243255 Feb 04 18:05:14.308603 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 309/614] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:14 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1721 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:05:14.502940 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-78397f3f-d28d-456e-95b1-cf051c674b76 req-498ef27b-696c-46cb-b3d8-c6df7302f016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1d9c781-2198-40c6-a4ec-cd2422de004d", "name": "network-vif-deleted", "tag": "bd315958-9ef0-4c3f-ada4-ba8b1c05202e"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:05:14.504951 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:05:14.504951 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:05:14.517189 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-78397f3f-d28d-456e-95b1-cf051c674b76 req-498ef27b-696c-46cb-b3d8-c6df7302f016 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:14.517636 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-78397f3f-d28d-456e-95b1-cf051c674b76 req-498ef27b-696c-46cb-b3d8-c6df7302f016 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:14.531464 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-78397f3f-d28d-456e-95b1-cf051c674b76 req-498ef27b-696c-46cb-b3d8-c6df7302f016 service nova] Creating event network-vif-deleted:bd315958-9ef0-4c3f-ada4-ba8b1c05202e for instance c1d9c781-2198-40c6-a4ec-cd2422de004d on hv-cinder-82276 Feb 04 18:05:14.537061 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-78397f3f-d28d-456e-95b1-cf051c674b76 req-498ef27b-696c-46cb-b3d8-c6df7302f016 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038226 Feb 04 18:05:14.538019 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 306/615] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:05:14.938452 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-90249088-da80-4f75-92fc-d98efc91758e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:14.939072 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-90249088-da80-4f75-92fc-d98efc91758e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:14.945370 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-90249088-da80-4f75-92fc-d98efc91758e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:14.945967 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-90249088-da80-4f75-92fc-d98efc91758e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:14.946654 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-90249088-da80-4f75-92fc-d98efc91758e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:14.947099 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-90249088-da80-4f75-92fc-d98efc91758e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:14.979725 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-90249088-da80-4f75-92fc-d98efc91758e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:14.980180 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-90249088-da80-4f75-92fc-d98efc91758e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:14.980641 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.objects.instance [None req-90249088-da80-4f75-92fc-d98efc91758e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lazy-loading 'fault' on Instance uuid c1d9c781-2198-40c6-a4ec-cd2422de004d {{(pid=123566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:05:15.027206 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-93136ffd-9141-481e-97d0-a28ff4df2787 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:15.027904 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-93136ffd-9141-481e-97d0-a28ff4df2787 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:15.034812 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-93136ffd-9141-481e-97d0-a28ff4df2787 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:15.035270 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-93136ffd-9141-481e-97d0-a28ff4df2787 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:15.036064 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-93136ffd-9141-481e-97d0-a28ff4df2787 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:15.036504 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-93136ffd-9141-481e-97d0-a28ff4df2787 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:15.040298 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-90249088-da80-4f75-92fc-d98efc91758e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9bd306bfd5f4867b300ada22547897f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a8ffd2aaf14a21a0545cb345ab262f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:15.048457 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-90249088-da80-4f75-92fc-d98efc91758e tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 200 len: 1307 microversion: 2.1 time: 0.113616 Feb 04 18:05:15.049137 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 310/616] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:14 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 1307 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:15.135698 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-93136ffd-9141-481e-97d0-a28ff4df2787 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:15.144001 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-93136ffd-9141-481e-97d0-a28ff4df2787 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1270 microversion: 2.1 time: 0.121232 Feb 04 18:05:15.153409 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 307/617] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:15 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1270 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:05:15.326314 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-cc9477b8-1ac6-4ef2-a263-eab671728ba3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:15.329919 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-cc9477b8-1ac6-4ef2-a263-eab671728ba3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:15.335117 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cc9477b8-1ac6-4ef2-a263-eab671728ba3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:15.335661 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cc9477b8-1ac6-4ef2-a263-eab671728ba3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:15.336846 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cc9477b8-1ac6-4ef2-a263-eab671728ba3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:15.337369 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cc9477b8-1ac6-4ef2-a263-eab671728ba3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:15.506029 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-cc9477b8-1ac6-4ef2-a263-eab671728ba3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:15.514752 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-cc9477b8-1ac6-4ef2-a263-eab671728ba3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:15.516530 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-cc9477b8-1ac6-4ef2-a263-eab671728ba3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:15.522660 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-cc9477b8-1ac6-4ef2-a263-eab671728ba3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1721 microversion: 2.20 time: 0.195345 Feb 04 18:05:15.522660 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 311/618] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:15 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:05:16.066888 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-98fb9d5e-6a1b-4d45-9db7-a29bf6f678eb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:16.066888 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-98fb9d5e-6a1b-4d45-9db7-a29bf6f678eb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] [instance: c1d9c781-2198-40c6-a4ec-cd2422de004d] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:16.072520 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-98fb9d5e-6a1b-4d45-9db7-a29bf6f678eb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:16.072973 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-98fb9d5e-6a1b-4d45-9db7-a29bf6f678eb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:16.073764 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-98fb9d5e-6a1b-4d45-9db7-a29bf6f678eb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:16.074203 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-98fb9d5e-6a1b-4d45-9db7-a29bf6f678eb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:16.087886 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.wsgi [None req-98fb9d5e-6a1b-4d45-9db7-a29bf6f678eb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] HTTP exception thrown: Instance c1d9c781-2198-40c6-a4ec-cd2422de004d could not be found. Feb 04 18:05:16.088481 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-98fb9d5e-6a1b-4d45-9db7-a29bf6f678eb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] Returning 404 to user: Instance c1d9c781-2198-40c6-a4ec-cd2422de004d could not be found. {{(pid=123567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:05:16.089308 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-98fb9d5e-6a1b-4d45-9db7-a29bf6f678eb tempest-AttachVolumeNegativeTest-1208253876 tempest-AttachVolumeNegativeTest-1208253876-project] 10.222.0.98 "GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d" status: 404 len: 111 microversion: 2.1 time: 0.028090 Feb 04 18:05:16.089866 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 308/619] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:16 2022] GET /compute/v2.1/servers/c1d9c781-2198-40c6-a4ec-cd2422de004d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:05:16.161505 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-f3a434bd-fd6a-4797-815e-4b021429b1b6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:16.162126 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-f3a434bd-fd6a-4797-815e-4b021429b1b6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:16.169034 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f3a434bd-fd6a-4797-815e-4b021429b1b6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:16.169492 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f3a434bd-fd6a-4797-815e-4b021429b1b6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:16.170288 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f3a434bd-fd6a-4797-815e-4b021429b1b6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:16.171310 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f3a434bd-fd6a-4797-815e-4b021429b1b6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:16.329365 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-f3a434bd-fd6a-4797-815e-4b021429b1b6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:16.337005 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-f3a434bd-fd6a-4797-815e-4b021429b1b6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1312 microversion: 2.1 time: 0.179119 Feb 04 18:05:16.337582 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 312/620] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:16 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1312 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:16.536303 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-232e3b7f-589b-4c20-96e7-df11fe69d897 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:16.537116 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-232e3b7f-589b-4c20-96e7-df11fe69d897 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:16.560741 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-232e3b7f-589b-4c20-96e7-df11fe69d897 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:16.562715 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-232e3b7f-589b-4c20-96e7-df11fe69d897 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:16.565135 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-232e3b7f-589b-4c20-96e7-df11fe69d897 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:16.566720 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-232e3b7f-589b-4c20-96e7-df11fe69d897 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:16.739547 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-dea6bb45-e732-404d-9abc-83d5c5c3e65a req-e16ea9ba-7e2d-4dd6-80e6-3aa3156e8281 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c749413-8ac1-41ed-a2e4-880b92af98ca", "tag": "486f07de-480b-4797-b2c8-3e28685a48b6"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:05:16.742974 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:05:16.742974 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:05:16.752937 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-dea6bb45-e732-404d-9abc-83d5c5c3e65a req-e16ea9ba-7e2d-4dd6-80e6-3aa3156e8281 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:16.753784 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-dea6bb45-e732-404d-9abc-83d5c5c3e65a req-e16ea9ba-7e2d-4dd6-80e6-3aa3156e8281 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:16.769456 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-dea6bb45-e732-404d-9abc-83d5c5c3e65a req-e16ea9ba-7e2d-4dd6-80e6-3aa3156e8281 service nova] Creating event network-changed:486f07de-480b-4797-b2c8-3e28685a48b6 for instance 7c749413-8ac1-41ed-a2e4-880b92af98ca on hv-cinder-82276 Feb 04 18:05:16.782155 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-dea6bb45-e732-404d-9abc-83d5c5c3e65a req-e16ea9ba-7e2d-4dd6-80e6-3aa3156e8281 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046689 Feb 04 18:05:16.782915 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 313/621] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:05:16.898174 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-232e3b7f-589b-4c20-96e7-df11fe69d897 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:16.907376 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-232e3b7f-589b-4c20-96e7-df11fe69d897 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:16.911004 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-232e3b7f-589b-4c20-96e7-df11fe69d897 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:16.911004 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-232e3b7f-589b-4c20-96e7-df11fe69d897 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1721 microversion: 2.20 time: 0.377733 Feb 04 18:05:16.911004 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 309/622] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:16 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1721 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:05:17.361320 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ec9da0a7-1977-4f62-9ddb-621e1c200667 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:17.362066 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ec9da0a7-1977-4f62-9ddb-621e1c200667 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:17.369092 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ec9da0a7-1977-4f62-9ddb-621e1c200667 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:17.371361 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ec9da0a7-1977-4f62-9ddb-621e1c200667 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:17.371361 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ec9da0a7-1977-4f62-9ddb-621e1c200667 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:17.371361 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ec9da0a7-1977-4f62-9ddb-621e1c200667 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:17.731395 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-ec9da0a7-1977-4f62-9ddb-621e1c200667 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:17.748482 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ec9da0a7-1977-4f62-9ddb-621e1c200667 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1312 microversion: 2.1 time: 0.391732 Feb 04 18:05:17.749936 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 314/623] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:17 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1312 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:17.950587 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-8b1240b0-2b68-496f-89d5-0b68a978326d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:17.952963 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-8b1240b0-2b68-496f-89d5-0b68a978326d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:17.970755 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8b1240b0-2b68-496f-89d5-0b68a978326d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:17.971958 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8b1240b0-2b68-496f-89d5-0b68a978326d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:17.973833 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8b1240b0-2b68-496f-89d5-0b68a978326d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:17.974882 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8b1240b0-2b68-496f-89d5-0b68a978326d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:18.377327 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-8b1240b0-2b68-496f-89d5-0b68a978326d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:18.399830 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-8b1240b0-2b68-496f-89d5-0b68a978326d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:18.402030 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-8b1240b0-2b68-496f-89d5-0b68a978326d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:18.411377 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-8b1240b0-2b68-496f-89d5-0b68a978326d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1721 microversion: 2.20 time: 0.484700 Feb 04 18:05:18.413123 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 310/624] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:17 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1721 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:05:18.774916 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-91c81fae-7229-4a41-b8e1-8b943a676234 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:18.777092 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-91c81fae-7229-4a41-b8e1-8b943a676234 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:18.793873 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-91c81fae-7229-4a41-b8e1-8b943a676234 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:18.795764 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-91c81fae-7229-4a41-b8e1-8b943a676234 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:18.802081 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-91c81fae-7229-4a41-b8e1-8b943a676234 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:18.803327 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-91c81fae-7229-4a41-b8e1-8b943a676234 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:19.164556 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-91c81fae-7229-4a41-b8e1-8b943a676234 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:19.173772 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-91c81fae-7229-4a41-b8e1-8b943a676234 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1312 microversion: 2.1 time: 0.407293 Feb 04 18:05:19.174256 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 315/625] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:18 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1312 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:19.446338 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-49b6dc9d-c796-43d4-9595-bbabca9893a9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:19.450529 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-49b6dc9d-c796-43d4-9595-bbabca9893a9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:19.462528 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-49b6dc9d-c796-43d4-9595-bbabca9893a9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:19.463690 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-49b6dc9d-c796-43d4-9595-bbabca9893a9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:19.466511 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-49b6dc9d-c796-43d4-9595-bbabca9893a9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:19.467915 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-49b6dc9d-c796-43d4-9595-bbabca9893a9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:19.817833 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-49b6dc9d-c796-43d4-9595-bbabca9893a9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:19.829994 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-49b6dc9d-c796-43d4-9595-bbabca9893a9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:19.833093 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-49b6dc9d-c796-43d4-9595-bbabca9893a9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:19.834722 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-49b6dc9d-c796-43d4-9595-bbabca9893a9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1721 microversion: 2.20 time: 0.400803 Feb 04 18:05:19.837370 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 311/626] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:19 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1721 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:05:20.192419 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b3ae66db-4931-417f-ae4e-da5c7ff090d5 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:20.193540 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-b3ae66db-4931-417f-ae4e-da5c7ff090d5 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:20.201423 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b3ae66db-4931-417f-ae4e-da5c7ff090d5 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:20.202950 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b3ae66db-4931-417f-ae4e-da5c7ff090d5 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:20.204055 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b3ae66db-4931-417f-ae4e-da5c7ff090d5 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:20.204617 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b3ae66db-4931-417f-ae4e-da5c7ff090d5 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:20.354864 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-c0ba8fc8-5a58-4be1-9ce9-614ecaaed268 tempest-VolumesGetTestJSON-1774264988 tempest-VolumesGetTestJSON-1774264988-project] Action: 'create', calling method: .version_select at 0x7fe8bffaa430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1111609506", "metadata": {"Type": "work"}}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:05:20.465934 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-b3ae66db-4931-417f-ae4e-da5c7ff090d5 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:20.482110 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b3ae66db-4931-417f-ae4e-da5c7ff090d5 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1312 microversion: 2.1 time: 0.294055 Feb 04 18:05:20.483798 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 312/627] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:20 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1312 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:20.871675 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c626ff95-0e6f-49f2-940c-2671ff2d9a4b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:20.873593 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c626ff95-0e6f-49f2-940c-2671ff2d9a4b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:20.887855 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c626ff95-0e6f-49f2-940c-2671ff2d9a4b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:20.889449 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c626ff95-0e6f-49f2-940c-2671ff2d9a4b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:20.891433 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c626ff95-0e6f-49f2-940c-2671ff2d9a4b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:20.892017 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c626ff95-0e6f-49f2-940c-2671ff2d9a4b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:21.099594 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c626ff95-0e6f-49f2-940c-2671ff2d9a4b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:21.118080 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c626ff95-0e6f-49f2-940c-2671ff2d9a4b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:21.121351 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c626ff95-0e6f-49f2-940c-2671ff2d9a4b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:21.123491 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c626ff95-0e6f-49f2-940c-2671ff2d9a4b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1721 microversion: 2.20 time: 0.261021 Feb 04 18:05:21.125175 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 313/628] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:20 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1721 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:05:21.371962 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-c0ba8fc8-5a58-4be1-9ce9-614ecaaed268 tempest-VolumesGetTestJSON-1774264988 tempest-VolumesGetTestJSON-1774264988-project] 10.222.0.98 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.270491 Feb 04 18:05:21.372592 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 316/629] 10.222.0.98 () {60 vars in 1155 bytes} [Fri Feb 4 18:05:20 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1272 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 04 18:05:21.384246 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-96b885d9-a166-42ac-9e22-1641961c93b2 tempest-VolumesGetTestJSON-1774264988 tempest-VolumesGetTestJSON-1774264988-project] Calling method '.version_select at 0x7fe8cc98e5e0>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:21.476111 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-96b885d9-a166-42ac-9e22-1641961c93b2 tempest-VolumesGetTestJSON-1774264988 tempest-VolumesGetTestJSON-1774264988-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/5401f9f8-6f18-48b6-b6c4-8fe8b604d46a" status: 200 len: 353 microversion: 2.1 time: 0.095072 Feb 04 18:05:21.477324 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 314/630] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Feb 4 18:05:21 2022] GET /compute/v2.1/os-volumes/5401f9f8-6f18-48b6-b6c4-8fe8b604d46a => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:05:21.500243 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b8b06d5c-5c2c-41b3-a46f-cf889ada1a45 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:21.500885 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-b8b06d5c-5c2c-41b3-a46f-cf889ada1a45 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:21.520514 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b8b06d5c-5c2c-41b3-a46f-cf889ada1a45 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:21.521253 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b8b06d5c-5c2c-41b3-a46f-cf889ada1a45 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:21.522504 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b8b06d5c-5c2c-41b3-a46f-cf889ada1a45 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:21.523473 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b8b06d5c-5c2c-41b3-a46f-cf889ada1a45 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:21.774036 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-b8b06d5c-5c2c-41b3-a46f-cf889ada1a45 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:21.797742 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-b8b06d5c-5c2c-41b3-a46f-cf889ada1a45 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1312 microversion: 2.1 time: 0.293831 Feb 04 18:05:21.797742 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 317/631] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:21 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1312 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:22.145490 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e385a3f5-0013-487b-b591-da3168dc8319 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:22.149622 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-e385a3f5-0013-487b-b591-da3168dc8319 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:22.156725 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e385a3f5-0013-487b-b591-da3168dc8319 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:22.157494 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e385a3f5-0013-487b-b591-da3168dc8319 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:22.158531 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e385a3f5-0013-487b-b591-da3168dc8319 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:22.159452 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e385a3f5-0013-487b-b591-da3168dc8319 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:22.330508 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e385a3f5-0013-487b-b591-da3168dc8319 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:22.347639 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e385a3f5-0013-487b-b591-da3168dc8319 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:22.352574 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e385a3f5-0013-487b-b591-da3168dc8319 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:22.355251 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e385a3f5-0013-487b-b591-da3168dc8319 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1721 microversion: 2.20 time: 0.213104 Feb 04 18:05:22.357497 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 315/632] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:22 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:05:22.495224 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-55c7b2a8-9745-4226-8fc9-120164724a71 tempest-VolumesGetTestJSON-1774264988 tempest-VolumesGetTestJSON-1774264988-project] Calling method '.version_select at 0x7fe8cc1d58b0>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:22.565293 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-55c7b2a8-9745-4226-8fc9-120164724a71 tempest-VolumesGetTestJSON-1774264988 tempest-VolumesGetTestJSON-1774264988-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/5401f9f8-6f18-48b6-b6c4-8fe8b604d46a" status: 200 len: 353 microversion: 2.1 time: 0.075750 Feb 04 18:05:22.565293 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 318/633] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Feb 4 18:05:22 2022] GET /compute/v2.1/os-volumes/5401f9f8-6f18-48b6-b6c4-8fe8b604d46a => generated 353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:05:22.817067 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-57373ec4-3b53-4e90-b6f7-2b7c54e5bb93 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:22.821596 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-57373ec4-3b53-4e90-b6f7-2b7c54e5bb93 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:22.825353 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-57373ec4-3b53-4e90-b6f7-2b7c54e5bb93 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:22.826183 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-57373ec4-3b53-4e90-b6f7-2b7c54e5bb93 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:22.827314 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-57373ec4-3b53-4e90-b6f7-2b7c54e5bb93 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:22.828030 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-57373ec4-3b53-4e90-b6f7-2b7c54e5bb93 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:23.018376 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-57373ec4-3b53-4e90-b6f7-2b7c54e5bb93 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:23.031634 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-57373ec4-3b53-4e90-b6f7-2b7c54e5bb93 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1312 microversion: 2.1 time: 0.218170 Feb 04 18:05:23.032533 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 316/634] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:22 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1312 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:23.300174 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-68b1f86f-476d-4a1e-a186-0eb4ee5d9943 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Action: 'create', calling method: .version_select at 0x7fe8bfffc0d0>, body: {"keypair": {"name": "tempest-keypair-873337665"}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:05:23.324679 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-68b1f86f-476d-4a1e-a186-0eb4ee5d9943 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Getting quotas for project ac0ec68d2c474dbf8c692e362abd93cb. Resources: {'key_pairs'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:05:23.332958 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-68b1f86f-476d-4a1e-a186-0eb4ee5d9943 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Getting quotas for user b75ec1e932d7429a9319213a04eb7766 and project ac0ec68d2c474dbf8c692e362abd93cb. Resources: {'key_pairs'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:05:23.375207 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a2197ddf-5253-4ec7-aa3e-074569612643 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:23.376122 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-a2197ddf-5253-4ec7-aa3e-074569612643 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:23.382586 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a2197ddf-5253-4ec7-aa3e-074569612643 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:23.383037 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a2197ddf-5253-4ec7-aa3e-074569612643 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:23.383830 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a2197ddf-5253-4ec7-aa3e-074569612643 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:23.384266 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a2197ddf-5253-4ec7-aa3e-074569612643 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:23.552978 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-a2197ddf-5253-4ec7-aa3e-074569612643 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:23.564915 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-a2197ddf-5253-4ec7-aa3e-074569612643 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:23.566836 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-a2197ddf-5253-4ec7-aa3e-074569612643 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:23.568281 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a2197ddf-5253-4ec7-aa3e-074569612643 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1721 microversion: 2.20 time: 0.197034 Feb 04 18:05:23.569044 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 317/635] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:23 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:05:23.585039 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-4319fa54-b04a-4eca-af1a-85558b08eab8 tempest-VolumesGetTestJSON-1774264988 tempest-VolumesGetTestJSON-1774264988-project] Calling method '.version_select at 0x7fe8cc98e550>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:23.674582 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-4319fa54-b04a-4eca-af1a-85558b08eab8 tempest-VolumesGetTestJSON-1774264988 tempest-VolumesGetTestJSON-1774264988-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/5401f9f8-6f18-48b6-b6c4-8fe8b604d46a" status: 200 len: 354 microversion: 2.1 time: 0.093051 Feb 04 18:05:23.675575 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 318/636] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Feb 4 18:05:23 2022] GET /compute/v2.1/os-volumes/5401f9f8-6f18-48b6-b6c4-8fe8b604d46a => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:05:23.692361 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e8c4f5d6-4c9c-4e5f-8fd7-dece5f9af852 tempest-VolumesGetTestJSON-1774264988 tempest-VolumesGetTestJSON-1774264988-project] Calling method '.version_select at 0x7fe8cc9690d0>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:23.722546 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-68b1f86f-476d-4a1e-a186-0eb4ee5d9943 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Getting quotas for project ac0ec68d2c474dbf8c692e362abd93cb. Resources: {'key_pairs'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:05:23.730877 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-68b1f86f-476d-4a1e-a186-0eb4ee5d9943 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Getting quotas for user b75ec1e932d7429a9319213a04eb7766 and project ac0ec68d2c474dbf8c692e362abd93cb. Resources: {'key_pairs'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:05:23.757455 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-68b1f86f-476d-4a1e-a186-0eb4ee5d9943 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.539529 Feb 04 18:05:23.758828 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 319/637] 10.222.0.98 () {60 vars in 1157 bytes} [Fri Feb 4 18:05:23 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:23.788902 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e8c4f5d6-4c9c-4e5f-8fd7-dece5f9af852 tempest-VolumesGetTestJSON-1774264988 tempest-VolumesGetTestJSON-1774264988-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/5401f9f8-6f18-48b6-b6c4-8fe8b604d46a" status: 200 len: 354 microversion: 2.1 time: 0.104431 Feb 04 18:05:23.805444 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 319/638] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Feb 4 18:05:23 2022] GET /compute/v2.1/os-volumes/5401f9f8-6f18-48b6-b6c4-8fe8b604d46a => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:05:23.815416 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-dcae2844-32b9-4fec-a0d9-5efea597e616 tempest-VolumesGetTestJSON-1774264988 tempest-VolumesGetTestJSON-1774264988-project] Calling method '.version_select at 0x7fe8bffa34c0>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:24.050150 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-1d4a09be-aec0-449c-b70b-5404a30adee9 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:24.054713 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-1d4a09be-aec0-449c-b70b-5404a30adee9 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:24.057973 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1d4a09be-aec0-449c-b70b-5404a30adee9 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:24.058457 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1d4a09be-aec0-449c-b70b-5404a30adee9 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:24.059248 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1d4a09be-aec0-449c-b70b-5404a30adee9 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:24.059772 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1d4a09be-aec0-449c-b70b-5404a30adee9 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:24.133376 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-dcae2844-32b9-4fec-a0d9-5efea597e616 tempest-VolumesGetTestJSON-1774264988 tempest-VolumesGetTestJSON-1774264988-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/5401f9f8-6f18-48b6-b6c4-8fe8b604d46a" status: 202 len: 0 microversion: 2.1 time: 0.321478 Feb 04 18:05:24.140856 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 320/639] 10.222.0.98 () {58 vars in 1247 bytes} [Fri Feb 4 18:05:23 2022] DELETE /compute/v2.1/os-volumes/5401f9f8-6f18-48b6-b6c4-8fe8b604d46a => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 04 18:05:24.143064 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-cc199911-633b-485b-974c-b738249229e4 tempest-VolumesGetTestJSON-1774264988 tempest-VolumesGetTestJSON-1774264988-project] Calling method '.version_select at 0x7fe8cc082040>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:24.208943 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-cc199911-633b-485b-974c-b738249229e4 tempest-VolumesGetTestJSON-1774264988 tempest-VolumesGetTestJSON-1774264988-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/5401f9f8-6f18-48b6-b6c4-8fe8b604d46a" status: 200 len: 353 microversion: 2.1 time: 0.070152 Feb 04 18:05:24.209342 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 321/640] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Feb 4 18:05:24 2022] GET /compute/v2.1/os-volumes/5401f9f8-6f18-48b6-b6c4-8fe8b604d46a => generated 353 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:05:24.278446 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-1d4a09be-aec0-449c-b70b-5404a30adee9 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:24.292207 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-1d4a09be-aec0-449c-b70b-5404a30adee9 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1312 microversion: 2.1 time: 0.246820 Feb 04 18:05:24.293277 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 320/641] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:24 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1312 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:05:24.587256 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-5fecd84d-c4dc-4b02-8599-2e187e870255 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:24.587783 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-5fecd84d-c4dc-4b02-8599-2e187e870255 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:24.595062 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5fecd84d-c4dc-4b02-8599-2e187e870255 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:24.595516 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5fecd84d-c4dc-4b02-8599-2e187e870255 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:24.596301 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5fecd84d-c4dc-4b02-8599-2e187e870255 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:24.596819 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5fecd84d-c4dc-4b02-8599-2e187e870255 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:24.761984 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-5fecd84d-c4dc-4b02-8599-2e187e870255 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:24.771408 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-5fecd84d-c4dc-4b02-8599-2e187e870255 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:24.773135 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-5fecd84d-c4dc-4b02-8599-2e187e870255 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:24.774482 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-5fecd84d-c4dc-4b02-8599-2e187e870255 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1721 microversion: 2.20 time: 0.191101 Feb 04 18:05:24.775053 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 322/642] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:24 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:05:25.221599 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c4ac1557-8d15-4936-a25b-1cf00fb012f0 tempest-VolumesGetTestJSON-1774264988 tempest-VolumesGetTestJSON-1774264988-project] Calling method '.version_select at 0x7fe8cc88ed30>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:25.269219 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c4ac1557-8d15-4936-a25b-1cf00fb012f0 tempest-VolumesGetTestJSON-1774264988 tempest-VolumesGetTestJSON-1774264988-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/5401f9f8-6f18-48b6-b6c4-8fe8b604d46a" status: 200 len: 353 microversion: 2.1 time: 0.051747 Feb 04 18:05:25.269894 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 321/643] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Feb 4 18:05:25 2022] GET /compute/v2.1/os-volumes/5401f9f8-6f18-48b6-b6c4-8fe8b604d46a => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:05:25.319062 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-331a1fc9-7298-4a9c-9f88-3d4ab58ba83e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:25.320689 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-331a1fc9-7298-4a9c-9f88-3d4ab58ba83e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:25.336246 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-331a1fc9-7298-4a9c-9f88-3d4ab58ba83e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:25.337692 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-331a1fc9-7298-4a9c-9f88-3d4ab58ba83e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:25.339252 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-331a1fc9-7298-4a9c-9f88-3d4ab58ba83e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:25.340994 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-331a1fc9-7298-4a9c-9f88-3d4ab58ba83e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:25.614447 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-331a1fc9-7298-4a9c-9f88-3d4ab58ba83e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:25.623750 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-331a1fc9-7298-4a9c-9f88-3d4ab58ba83e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1312 microversion: 2.1 time: 0.314227 Feb 04 18:05:25.625090 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 323/644] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:25 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1312 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:25.812993 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-5d0555fc-9163-412d-94bf-6e0ac767e2c0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:25.816741 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-5d0555fc-9163-412d-94bf-6e0ac767e2c0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:25.843329 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5d0555fc-9163-412d-94bf-6e0ac767e2c0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:25.844964 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5d0555fc-9163-412d-94bf-6e0ac767e2c0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:25.847157 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5d0555fc-9163-412d-94bf-6e0ac767e2c0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:25.848242 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5d0555fc-9163-412d-94bf-6e0ac767e2c0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:26.120728 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5d0555fc-9163-412d-94bf-6e0ac767e2c0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:26.135187 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5d0555fc-9163-412d-94bf-6e0ac767e2c0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:26.138759 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5d0555fc-9163-412d-94bf-6e0ac767e2c0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:26.144736 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-5d0555fc-9163-412d-94bf-6e0ac767e2c0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1721 microversion: 2.20 time: 0.353122 Feb 04 18:05:26.146111 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 322/645] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:25 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1721 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:05:26.285923 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-f9a67b87-f263-4ff3-87e4-676ea04befd8 tempest-VolumesGetTestJSON-1774264988 tempest-VolumesGetTestJSON-1774264988-project] Calling method '.version_select at 0x7fe8cc1051f0>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:26.386289 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-f9a67b87-f263-4ff3-87e4-676ea04befd8 tempest-VolumesGetTestJSON-1774264988 tempest-VolumesGetTestJSON-1774264988-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/5401f9f8-6f18-48b6-b6c4-8fe8b604d46a" status: 200 len: 353 microversion: 2.1 time: 0.104293 Feb 04 18:05:26.387778 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 324/646] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Feb 4 18:05:26 2022] GET /compute/v2.1/os-volumes/5401f9f8-6f18-48b6-b6c4-8fe8b604d46a => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:05:26.654731 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-ecc2afc2-a9bf-4696-82aa-be800413cd9c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:26.656333 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-ecc2afc2-a9bf-4696-82aa-be800413cd9c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:26.667178 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ecc2afc2-a9bf-4696-82aa-be800413cd9c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:26.667999 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ecc2afc2-a9bf-4696-82aa-be800413cd9c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:26.669079 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ecc2afc2-a9bf-4696-82aa-be800413cd9c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:26.669849 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ecc2afc2-a9bf-4696-82aa-be800413cd9c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:26.857210 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-1d06b52e-7404-4a20-b474-c7cf1cafdfc9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-303703094", "imageRef": "b0fb57f5-967d-4692-94f3-accee37910c3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad908c4b-c2c9-46d5-a416-1e7a31ac0b31"}], "security_groups": [{"name": "tempest-securitygroup--1422956166"}], "key_name": "tempest-keypair-873337665", "user_data": "}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:05:26.896408 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ecc2afc2-a9bf-4696-82aa-be800413cd9c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:26.909302 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-ecc2afc2-a9bf-4696-82aa-be800413cd9c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1312 microversion: 2.1 time: 0.262589 Feb 04 18:05:26.910260 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 323/647] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:26 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1312 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:27.002480 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.network.neutron [None req-1d06b52e-7404-4a20-b474-c7cf1cafdfc9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] validate_networks() for [('ad908c4b-c2c9-46d5-a416-1e7a31ac0b31', None, None, None, None, None)] {{(pid=123566) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 04 18:05:27.173230 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-2b3a96f9-2e2d-42aa-b1dd-df54b1c181e9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:27.173845 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-2b3a96f9-2e2d-42aa-b1dd-df54b1c181e9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:27.179921 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2b3a96f9-2e2d-42aa-b1dd-df54b1c181e9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:27.180375 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2b3a96f9-2e2d-42aa-b1dd-df54b1c181e9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:27.181177 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2b3a96f9-2e2d-42aa-b1dd-df54b1c181e9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:27.181601 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2b3a96f9-2e2d-42aa-b1dd-df54b1c181e9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:27.404430 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-2b3a96f9-2e2d-42aa-b1dd-df54b1c181e9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:27.413831 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-2b3a96f9-2e2d-42aa-b1dd-df54b1c181e9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:27.415563 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-2b3a96f9-2e2d-42aa-b1dd-df54b1c181e9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:27.416794 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-2b3a96f9-2e2d-42aa-b1dd-df54b1c181e9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1721 microversion: 2.20 time: 0.247362 Feb 04 18:05:27.417792 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 324/648] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:27 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1721 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:05:27.422777 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-af9c6ea4-db6e-4009-a8bc-ac996e181b1b tempest-VolumesGetTestJSON-1774264988 tempest-VolumesGetTestJSON-1774264988-project] Calling method '.version_select at 0x7fe8cc8b2ee0>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:27.474442 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-af9c6ea4-db6e-4009-a8bc-ac996e181b1b tempest-VolumesGetTestJSON-1774264988 tempest-VolumesGetTestJSON-1774264988-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/5401f9f8-6f18-48b6-b6c4-8fe8b604d46a" status: 200 len: 353 microversion: 2.1 time: 0.055771 Feb 04 18:05:27.478372 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 325/649] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Feb 4 18:05:27 2022] GET /compute/v2.1/os-volumes/5401f9f8-6f18-48b6-b6c4-8fe8b604d46a => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:05:27.537725 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-1d06b52e-7404-4a20-b474-c7cf1cafdfc9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Flavor limits 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 04 18:05:27.538195 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-1d06b52e-7404-4a20-b474-c7cf1cafdfc9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Image limits 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 04 18:05:27.538736 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-1d06b52e-7404-4a20-b474-c7cf1cafdfc9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Flavor pref 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 04 18:05:27.539225 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-1d06b52e-7404-4a20-b474-c7cf1cafdfc9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Image pref 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 04 18:05:27.539721 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-1d06b52e-7404-4a20-b474-c7cf1cafdfc9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 04 18:05:27.552735 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1d06b52e-7404-4a20-b474-c7cf1cafdfc9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:27.553551 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1d06b52e-7404-4a20-b474-c7cf1cafdfc9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:27.554878 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1d06b52e-7404-4a20-b474-c7cf1cafdfc9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:27.555676 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1d06b52e-7404-4a20-b474-c7cf1cafdfc9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:27.575036 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-1d06b52e-7404-4a20-b474-c7cf1cafdfc9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Getting quotas for project ac0ec68d2c474dbf8c692e362abd93cb. Resources: {'cores', 'ram', 'instances'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:05:27.580510 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-1d06b52e-7404-4a20-b474-c7cf1cafdfc9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Getting quotas for user b75ec1e932d7429a9319213a04eb7766 and project ac0ec68d2c474dbf8c692e362abd93cb. Resources: {'cores', 'ram', 'instances'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:05:27.602012 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-1d06b52e-7404-4a20-b474-c7cf1cafdfc9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Going to run 1 instances... {{(pid=123566) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 04 18:05:27.604529 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-1d06b52e-7404-4a20-b474-c7cf1cafdfc9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0fb57f5-967d-4692-94f3-accee37910c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 04 18:05:27.759149 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-1d06b52e-7404-4a20-b474-c7cf1cafdfc9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.909529 Feb 04 18:05:27.759818 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 325/650] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Feb 4 18:05:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 04 18:05:27.772988 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-85a5587c-97d1-46c2-b54d-85b19cc6c86f tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:27.773613 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-85a5587c-97d1-46c2-b54d-85b19cc6c86f tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:27.845089 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-85a5587c-97d1-46c2-b54d-85b19cc6c86f tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:27.857527 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-85a5587c-97d1-46c2-b54d-85b19cc6c86f tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1236 microversion: 2.1 time: 0.089934 Feb 04 18:05:27.859239 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 326/651] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:27 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1236 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:27.936164 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-058b4fef-b843-4bb9-8c2d-271f3bec2b82 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:27.936966 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-058b4fef-b843-4bb9-8c2d-271f3bec2b82 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:27.944666 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-058b4fef-b843-4bb9-8c2d-271f3bec2b82 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:27.945111 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-058b4fef-b843-4bb9-8c2d-271f3bec2b82 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:27.945901 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-058b4fef-b843-4bb9-8c2d-271f3bec2b82 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:27.946335 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-058b4fef-b843-4bb9-8c2d-271f3bec2b82 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:28.102641 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-058b4fef-b843-4bb9-8c2d-271f3bec2b82 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:28.110298 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-058b4fef-b843-4bb9-8c2d-271f3bec2b82 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1312 microversion: 2.1 time: 0.178223 Feb 04 18:05:28.110983 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 326/652] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:27 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1312 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:28.435917 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-0b865845-53e8-44bc-8ede-c6e260bef963 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:28.437333 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-0b865845-53e8-44bc-8ede-c6e260bef963 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:28.443770 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0b865845-53e8-44bc-8ede-c6e260bef963 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:28.444224 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0b865845-53e8-44bc-8ede-c6e260bef963 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:28.445026 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0b865845-53e8-44bc-8ede-c6e260bef963 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:28.445501 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0b865845-53e8-44bc-8ede-c6e260bef963 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:28.490620 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-5f265b65-339f-4697-967d-efd465036f24 tempest-VolumesGetTestJSON-1774264988 tempest-VolumesGetTestJSON-1774264988-project] Calling method '.version_select at 0x7fe8bffbe940>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:28.552304 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-5f265b65-339f-4697-967d-efd465036f24 tempest-VolumesGetTestJSON-1774264988 tempest-VolumesGetTestJSON-1774264988-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/5401f9f8-6f18-48b6-b6c4-8fe8b604d46a" status: 200 len: 353 microversion: 2.1 time: 0.067284 Feb 04 18:05:28.553090 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 327/653] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Feb 4 18:05:28 2022] GET /compute/v2.1/os-volumes/5401f9f8-6f18-48b6-b6c4-8fe8b604d46a => generated 353 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:05:28.613662 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-0b865845-53e8-44bc-8ede-c6e260bef963 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:28.622599 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-0b865845-53e8-44bc-8ede-c6e260bef963 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:28.624673 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-0b865845-53e8-44bc-8ede-c6e260bef963 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:28.625942 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-0b865845-53e8-44bc-8ede-c6e260bef963 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1721 microversion: 2.20 time: 0.193836 Feb 04 18:05:28.626542 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 327/654] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:28 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:05:28.876212 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-356708e3-59cf-4fbd-a900-b8ffcefebc7b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:28.876893 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-356708e3-59cf-4fbd-a900-b8ffcefebc7b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:28.940561 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-356708e3-59cf-4fbd-a900-b8ffcefebc7b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:28.951874 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-356708e3-59cf-4fbd-a900-b8ffcefebc7b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1236 microversion: 2.1 time: 0.079998 Feb 04 18:05:28.956135 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 328/655] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:28 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1236 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:29.128002 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-5a0c7b56-bb03-4eac-8e1c-e5daebde84b5 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:29.128891 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-5a0c7b56-bb03-4eac-8e1c-e5daebde84b5 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:29.135286 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5a0c7b56-bb03-4eac-8e1c-e5daebde84b5 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:29.139047 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5a0c7b56-bb03-4eac-8e1c-e5daebde84b5 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:29.139047 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5a0c7b56-bb03-4eac-8e1c-e5daebde84b5 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:29.139047 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5a0c7b56-bb03-4eac-8e1c-e5daebde84b5 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:29.276735 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5a0c7b56-bb03-4eac-8e1c-e5daebde84b5 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:29.284633 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-5a0c7b56-bb03-4eac-8e1c-e5daebde84b5 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1312 microversion: 2.1 time: 0.160805 Feb 04 18:05:29.285339 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 328/656] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:29 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:29.565149 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-9d88b784-d75c-44dc-86bb-418c90f10dbc tempest-VolumesGetTestJSON-1774264988 tempest-VolumesGetTestJSON-1774264988-project] Calling method '.version_select at 0x7fe8cc0a5e50>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:29.591635 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-9d88b784-d75c-44dc-86bb-418c90f10dbc tempest-VolumesGetTestJSON-1774264988 tempest-VolumesGetTestJSON-1774264988-project] HTTP exception thrown: Volume 5401f9f8-6f18-48b6-b6c4-8fe8b604d46a could not be found. Feb 04 18:05:29.594563 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-9d88b784-d75c-44dc-86bb-418c90f10dbc tempest-VolumesGetTestJSON-1774264988 tempest-VolumesGetTestJSON-1774264988-project] Returning 404 to user: Volume 5401f9f8-6f18-48b6-b6c4-8fe8b604d46a could not be found. {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:05:29.594563 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-9d88b784-d75c-44dc-86bb-418c90f10dbc tempest-VolumesGetTestJSON-1774264988 tempest-VolumesGetTestJSON-1774264988-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/5401f9f8-6f18-48b6-b6c4-8fe8b604d46a" status: 404 len: 109 microversion: 2.1 time: 0.033026 Feb 04 18:05:29.594563 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 329/657] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Feb 4 18:05:29 2022] GET /compute/v2.1/os-volumes/5401f9f8-6f18-48b6-b6c4-8fe8b604d46a => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:05:29.643795 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-93de45d8-0566-4438-8a89-d4cba4a6a41e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:29.644452 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-93de45d8-0566-4438-8a89-d4cba4a6a41e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:29.650956 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-93de45d8-0566-4438-8a89-d4cba4a6a41e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:29.652530 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-93de45d8-0566-4438-8a89-d4cba4a6a41e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:29.653837 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-93de45d8-0566-4438-8a89-d4cba4a6a41e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:29.654346 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-93de45d8-0566-4438-8a89-d4cba4a6a41e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:29.806587 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-93de45d8-0566-4438-8a89-d4cba4a6a41e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:29.817165 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-93de45d8-0566-4438-8a89-d4cba4a6a41e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:29.819710 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-93de45d8-0566-4438-8a89-d4cba4a6a41e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:29.820881 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-93de45d8-0566-4438-8a89-d4cba4a6a41e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1721 microversion: 2.20 time: 0.181070 Feb 04 18:05:29.821575 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 329/658] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:29 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:05:29.975276 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-76b0e6b8-3126-40f4-b1ea-1888bed63440 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:29.975891 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-76b0e6b8-3126-40f4-b1ea-1888bed63440 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:29.983567 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-76b0e6b8-3126-40f4-b1ea-1888bed63440 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:29.984284 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-76b0e6b8-3126-40f4-b1ea-1888bed63440 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:29.985082 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-76b0e6b8-3126-40f4-b1ea-1888bed63440 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:29.985515 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-76b0e6b8-3126-40f4-b1ea-1888bed63440 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:30.055653 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-76b0e6b8-3126-40f4-b1ea-1888bed63440 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:30.086365 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-76b0e6b8-3126-40f4-b1ea-1888bed63440 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1288 microversion: 2.1 time: 0.097557 Feb 04 18:05:30.086365 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 330/659] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:29 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1288 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:30.303324 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-6e693db4-935d-4a9c-9b00-80e8fd438630 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:30.305818 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-6e693db4-935d-4a9c-9b00-80e8fd438630 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:30.310892 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6e693db4-935d-4a9c-9b00-80e8fd438630 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:30.311993 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6e693db4-935d-4a9c-9b00-80e8fd438630 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:30.312799 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6e693db4-935d-4a9c-9b00-80e8fd438630 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:30.313234 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6e693db4-935d-4a9c-9b00-80e8fd438630 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:30.596856 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-6e693db4-935d-4a9c-9b00-80e8fd438630 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:30.616176 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-6e693db4-935d-4a9c-9b00-80e8fd438630 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1312 microversion: 2.1 time: 0.315430 Feb 04 18:05:30.618551 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 330/660] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:30 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1312 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:05:30.844835 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-d775a2e0-8b2b-4fda-a055-515832b756cf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:30.845758 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-d775a2e0-8b2b-4fda-a055-515832b756cf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:30.856539 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d775a2e0-8b2b-4fda-a055-515832b756cf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:30.857986 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d775a2e0-8b2b-4fda-a055-515832b756cf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:30.860645 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d775a2e0-8b2b-4fda-a055-515832b756cf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:30.861441 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d775a2e0-8b2b-4fda-a055-515832b756cf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:31.108319 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-18561990-ea6f-4e39-9e06-ebb380e2e0f8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:31.110250 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-18561990-ea6f-4e39-9e06-ebb380e2e0f8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:31.126341 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-18561990-ea6f-4e39-9e06-ebb380e2e0f8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:31.128558 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-18561990-ea6f-4e39-9e06-ebb380e2e0f8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:31.138626 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-d775a2e0-8b2b-4fda-a055-515832b756cf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:31.141641 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-18561990-ea6f-4e39-9e06-ebb380e2e0f8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:31.143887 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-18561990-ea6f-4e39-9e06-ebb380e2e0f8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:31.154373 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-d775a2e0-8b2b-4fda-a055-515832b756cf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:31.156030 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-d775a2e0-8b2b-4fda-a055-515832b756cf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:31.157554 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-d775a2e0-8b2b-4fda-a055-515832b756cf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1742 microversion: 2.20 time: 0.317803 Feb 04 18:05:31.158527 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 331/661] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:30 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1742 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:05:31.230841 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-18561990-ea6f-4e39-9e06-ebb380e2e0f8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:31.240258 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-18561990-ea6f-4e39-9e06-ebb380e2e0f8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1294 microversion: 2.1 time: 0.153132 Feb 04 18:05:31.241265 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 331/662] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:31 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1294 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:31.651376 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-f524d9cc-da2a-4c7e-ba46-f22559be2510 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:31.652510 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-f524d9cc-da2a-4c7e-ba46-f22559be2510 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:31.663901 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f524d9cc-da2a-4c7e-ba46-f22559be2510 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:31.664736 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f524d9cc-da2a-4c7e-ba46-f22559be2510 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:31.666350 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f524d9cc-da2a-4c7e-ba46-f22559be2510 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:31.666993 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f524d9cc-da2a-4c7e-ba46-f22559be2510 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:31.890207 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-f524d9cc-da2a-4c7e-ba46-f22559be2510 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:31.898369 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-f524d9cc-da2a-4c7e-ba46-f22559be2510 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1312 microversion: 2.1 time: 0.254063 Feb 04 18:05:31.899008 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 332/663] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:31 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1312 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:32.190021 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-bd419823-e524-4423-8dfc-864ea72ddb10 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:32.191377 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-bd419823-e524-4423-8dfc-864ea72ddb10 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:32.205363 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bd419823-e524-4423-8dfc-864ea72ddb10 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:32.206401 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bd419823-e524-4423-8dfc-864ea72ddb10 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:32.207866 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bd419823-e524-4423-8dfc-864ea72ddb10 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:32.208670 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bd419823-e524-4423-8dfc-864ea72ddb10 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:32.259088 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-d39b7618-ff42-489e-a478-b512b1553d80 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:32.260345 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-d39b7618-ff42-489e-a478-b512b1553d80 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:32.269833 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d39b7618-ff42-489e-a478-b512b1553d80 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:32.270782 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d39b7618-ff42-489e-a478-b512b1553d80 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:32.271972 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d39b7618-ff42-489e-a478-b512b1553d80 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:32.272692 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d39b7618-ff42-489e-a478-b512b1553d80 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:32.524112 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-bd419823-e524-4423-8dfc-864ea72ddb10 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:32.534181 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-d39b7618-ff42-489e-a478-b512b1553d80 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:32.536831 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-bd419823-e524-4423-8dfc-864ea72ddb10 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:32.539560 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-bd419823-e524-4423-8dfc-864ea72ddb10 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:32.541556 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-bd419823-e524-4423-8dfc-864ea72ddb10 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1742 microversion: 2.20 time: 0.355682 Feb 04 18:05:32.542847 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 332/664] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:32 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1742 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:05:32.546104 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-d39b7618-ff42-489e-a478-b512b1553d80 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1362 microversion: 2.1 time: 0.292194 Feb 04 18:05:32.546950 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 333/665] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:32 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1362 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:05:32.914757 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-9cf5f47c-79a4-42cc-ae9c-9d49aaf1de77 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:32.915380 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-9cf5f47c-79a4-42cc-ae9c-9d49aaf1de77 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:32.922277 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9cf5f47c-79a4-42cc-ae9c-9d49aaf1de77 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:32.922758 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9cf5f47c-79a4-42cc-ae9c-9d49aaf1de77 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:32.923539 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9cf5f47c-79a4-42cc-ae9c-9d49aaf1de77 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:32.923973 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9cf5f47c-79a4-42cc-ae9c-9d49aaf1de77 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:33.076498 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-9cf5f47c-79a4-42cc-ae9c-9d49aaf1de77 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:33.084905 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-9cf5f47c-79a4-42cc-ae9c-9d49aaf1de77 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1312 microversion: 2.1 time: 0.173684 Feb 04 18:05:33.085294 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 333/666] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:32 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1312 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:33.562080 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-7dd7854f-552a-4ad5-84cf-b87a017f3fbf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:33.563261 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-7dd7854f-552a-4ad5-84cf-b87a017f3fbf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:33.564961 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-fd9f86d0-4aa3-4683-b581-99bc45640252 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:33.565862 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-fd9f86d0-4aa3-4683-b581-99bc45640252 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:33.572282 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7dd7854f-552a-4ad5-84cf-b87a017f3fbf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:33.572843 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7dd7854f-552a-4ad5-84cf-b87a017f3fbf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:33.573897 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fd9f86d0-4aa3-4683-b581-99bc45640252 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:33.574097 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7dd7854f-552a-4ad5-84cf-b87a017f3fbf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:33.574578 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fd9f86d0-4aa3-4683-b581-99bc45640252 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:33.574786 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7dd7854f-552a-4ad5-84cf-b87a017f3fbf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:33.575558 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fd9f86d0-4aa3-4683-b581-99bc45640252 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:33.576116 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fd9f86d0-4aa3-4683-b581-99bc45640252 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:33.793352 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-fd9f86d0-4aa3-4683-b581-99bc45640252 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:33.802023 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-7dd7854f-552a-4ad5-84cf-b87a017f3fbf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:33.804254 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-fd9f86d0-4aa3-4683-b581-99bc45640252 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1362 microversion: 2.1 time: 0.243885 Feb 04 18:05:33.805196 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 334/667] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:33 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:05:33.818043 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-7dd7854f-552a-4ad5-84cf-b87a017f3fbf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:33.822953 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-7dd7854f-552a-4ad5-84cf-b87a017f3fbf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:33.822953 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-7dd7854f-552a-4ad5-84cf-b87a017f3fbf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1742 microversion: 2.20 time: 0.264602 Feb 04 18:05:33.822953 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 334/668] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:33 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1742 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:05:34.103307 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-5a567b8c-3163-4dca-b175-45644e9fe5e6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:34.104084 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-5a567b8c-3163-4dca-b175-45644e9fe5e6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:34.110273 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5a567b8c-3163-4dca-b175-45644e9fe5e6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:34.110849 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5a567b8c-3163-4dca-b175-45644e9fe5e6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:34.111737 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5a567b8c-3163-4dca-b175-45644e9fe5e6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:34.112292 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5a567b8c-3163-4dca-b175-45644e9fe5e6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:34.259416 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5a567b8c-3163-4dca-b175-45644e9fe5e6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:34.267988 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-5a567b8c-3163-4dca-b175-45644e9fe5e6 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1312 microversion: 2.1 time: 0.168665 Feb 04 18:05:34.268574 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 335/669] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:34 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1312 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:34.829317 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-16005bb0-5dd7-495a-ba3a-3ec06b357e17 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:34.829317 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-16005bb0-5dd7-495a-ba3a-3ec06b357e17 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:34.835981 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-16005bb0-5dd7-495a-ba3a-3ec06b357e17 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:34.836378 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-16005bb0-5dd7-495a-ba3a-3ec06b357e17 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:34.837172 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-16005bb0-5dd7-495a-ba3a-3ec06b357e17 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:34.837602 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-16005bb0-5dd7-495a-ba3a-3ec06b357e17 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:34.840870 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-9b8e898e-fe67-4acd-bdad-af33e8393839 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:34.841462 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-9b8e898e-fe67-4acd-bdad-af33e8393839 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:34.855932 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9b8e898e-fe67-4acd-bdad-af33e8393839 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:34.856532 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9b8e898e-fe67-4acd-bdad-af33e8393839 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:34.857414 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9b8e898e-fe67-4acd-bdad-af33e8393839 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:34.857953 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9b8e898e-fe67-4acd-bdad-af33e8393839 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:35.046412 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-16005bb0-5dd7-495a-ba3a-3ec06b357e17 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:35.054374 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-16005bb0-5dd7-495a-ba3a-3ec06b357e17 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1362 microversion: 2.1 time: 0.229467 Feb 04 18:05:35.055131 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 335/670] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:34 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:35.057074 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-9b8e898e-fe67-4acd-bdad-af33e8393839 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:35.065691 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-9b8e898e-fe67-4acd-bdad-af33e8393839 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:35.067232 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-9b8e898e-fe67-4acd-bdad-af33e8393839 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:35.068382 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-9b8e898e-fe67-4acd-bdad-af33e8393839 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1742 microversion: 2.20 time: 0.231285 Feb 04 18:05:35.068939 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 336/671] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:34 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1742 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:05:35.285054 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-3cc383a4-fb7a-4ad5-8abf-3373b93cec10 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:35.285658 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-3cc383a4-fb7a-4ad5-8abf-3373b93cec10 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:35.291884 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3cc383a4-fb7a-4ad5-8abf-3373b93cec10 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:35.292334 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3cc383a4-fb7a-4ad5-8abf-3373b93cec10 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:35.293113 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3cc383a4-fb7a-4ad5-8abf-3373b93cec10 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:35.293548 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3cc383a4-fb7a-4ad5-8abf-3373b93cec10 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:35.428238 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-3cc383a4-fb7a-4ad5-8abf-3373b93cec10 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:35.435771 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-3cc383a4-fb7a-4ad5-8abf-3373b93cec10 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1312 microversion: 2.1 time: 0.154374 Feb 04 18:05:35.436995 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 336/672] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:35 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:36.071752 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-0be488a8-e3c8-48ee-9048-82c3a45ec976 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:36.072395 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-0be488a8-e3c8-48ee-9048-82c3a45ec976 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:36.078810 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0be488a8-e3c8-48ee-9048-82c3a45ec976 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:36.079253 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0be488a8-e3c8-48ee-9048-82c3a45ec976 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:36.080080 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0be488a8-e3c8-48ee-9048-82c3a45ec976 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:36.080499 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0be488a8-e3c8-48ee-9048-82c3a45ec976 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:36.086655 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-98f98dd2-4928-4299-8a3d-19a041f16d24 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:36.087272 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-98f98dd2-4928-4299-8a3d-19a041f16d24 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:36.094261 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-98f98dd2-4928-4299-8a3d-19a041f16d24 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:36.094740 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-98f98dd2-4928-4299-8a3d-19a041f16d24 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:36.095541 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-98f98dd2-4928-4299-8a3d-19a041f16d24 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:36.095979 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-98f98dd2-4928-4299-8a3d-19a041f16d24 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:36.290753 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-0be488a8-e3c8-48ee-9048-82c3a45ec976 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:36.294079 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-98f98dd2-4928-4299-8a3d-19a041f16d24 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:36.298345 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-0be488a8-e3c8-48ee-9048-82c3a45ec976 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1362 microversion: 2.1 time: 0.230228 Feb 04 18:05:36.298957 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 337/673] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:36 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:36.302098 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-98f98dd2-4928-4299-8a3d-19a041f16d24 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:36.303643 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-98f98dd2-4928-4299-8a3d-19a041f16d24 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:36.304829 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-98f98dd2-4928-4299-8a3d-19a041f16d24 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1742 microversion: 2.20 time: 0.221944 Feb 04 18:05:36.305380 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 337/674] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:36 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1742 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:05:36.453789 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e4441ec7-2a8e-495d-beb4-812a1b61faa0 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:36.454310 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-e4441ec7-2a8e-495d-beb4-812a1b61faa0 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:36.460575 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e4441ec7-2a8e-495d-beb4-812a1b61faa0 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:36.461028 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e4441ec7-2a8e-495d-beb4-812a1b61faa0 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:36.461815 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e4441ec7-2a8e-495d-beb4-812a1b61faa0 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:36.462258 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e4441ec7-2a8e-495d-beb4-812a1b61faa0 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:36.600248 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e4441ec7-2a8e-495d-beb4-812a1b61faa0 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:36.607570 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e4441ec7-2a8e-495d-beb4-812a1b61faa0 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1312 microversion: 2.1 time: 0.158356 Feb 04 18:05:36.608185 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 338/675] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:36 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:37.314676 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-04012345-8f05-4b77-a6f1-786d918f98f1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:37.315273 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-04012345-8f05-4b77-a6f1-786d918f98f1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:37.321920 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-04012345-8f05-4b77-a6f1-786d918f98f1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:37.322373 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-04012345-8f05-4b77-a6f1-786d918f98f1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:37.323193 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-04012345-8f05-4b77-a6f1-786d918f98f1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:37.323305 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-9f8e1c67-4a1c-402c-928f-75724fd26dc6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:37.323813 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-04012345-8f05-4b77-a6f1-786d918f98f1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:37.323909 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-9f8e1c67-4a1c-402c-928f-75724fd26dc6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:37.330305 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9f8e1c67-4a1c-402c-928f-75724fd26dc6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:37.330804 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9f8e1c67-4a1c-402c-928f-75724fd26dc6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:37.331588 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9f8e1c67-4a1c-402c-928f-75724fd26dc6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:37.332021 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9f8e1c67-4a1c-402c-928f-75724fd26dc6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:37.521000 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-04012345-8f05-4b77-a6f1-786d918f98f1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:37.524300 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-9f8e1c67-4a1c-402c-928f-75724fd26dc6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:37.528311 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-04012345-8f05-4b77-a6f1-786d918f98f1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1362 microversion: 2.1 time: 0.217279 Feb 04 18:05:37.528917 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 338/676] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:37 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:37.533007 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-9f8e1c67-4a1c-402c-928f-75724fd26dc6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:37.534676 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-9f8e1c67-4a1c-402c-928f-75724fd26dc6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:37.535922 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-9f8e1c67-4a1c-402c-928f-75724fd26dc6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1742 microversion: 2.20 time: 0.216790 Feb 04 18:05:37.536661 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 339/677] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:37 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1742 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:05:37.624218 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-96a6574b-6c7d-4a5b-935c-de4b5f765437 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:37.624823 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-96a6574b-6c7d-4a5b-935c-de4b5f765437 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:37.631020 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-96a6574b-6c7d-4a5b-935c-de4b5f765437 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:37.631468 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-96a6574b-6c7d-4a5b-935c-de4b5f765437 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:37.632265 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-96a6574b-6c7d-4a5b-935c-de4b5f765437 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:37.632703 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-96a6574b-6c7d-4a5b-935c-de4b5f765437 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:37.769973 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-96a6574b-6c7d-4a5b-935c-de4b5f765437 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:37.777257 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-96a6574b-6c7d-4a5b-935c-de4b5f765437 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1312 microversion: 2.1 time: 0.156689 Feb 04 18:05:37.777837 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 339/678] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:37 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:38.544977 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-cdf15612-7fe3-4a02-bedf-f23b6b6395fd tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:38.546845 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-cdf15612-7fe3-4a02-bedf-f23b6b6395fd tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:38.554207 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-4ecb4f5b-968d-4e97-b526-6ebabaccaa38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:38.554843 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-4ecb4f5b-968d-4e97-b526-6ebabaccaa38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:38.566467 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4ecb4f5b-968d-4e97-b526-6ebabaccaa38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:38.568368 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cdf15612-7fe3-4a02-bedf-f23b6b6395fd tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:38.568824 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cdf15612-7fe3-4a02-bedf-f23b6b6395fd tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:38.569632 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cdf15612-7fe3-4a02-bedf-f23b6b6395fd tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:38.570070 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cdf15612-7fe3-4a02-bedf-f23b6b6395fd tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:38.573366 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4ecb4f5b-968d-4e97-b526-6ebabaccaa38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:38.574458 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4ecb4f5b-968d-4e97-b526-6ebabaccaa38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:38.574893 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4ecb4f5b-968d-4e97-b526-6ebabaccaa38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:38.791701 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-cdf15612-7fe3-4a02-bedf-f23b6b6395fd tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:38.792936 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-4ecb4f5b-968d-4e97-b526-6ebabaccaa38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:38.800247 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-cdf15612-7fe3-4a02-bedf-f23b6b6395fd tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1362 microversion: 2.1 time: 0.258702 Feb 04 18:05:38.807848 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-4ecb4f5b-968d-4e97-b526-6ebabaccaa38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:38.812287 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-4ecb4f5b-968d-4e97-b526-6ebabaccaa38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:38.813475 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-4ecb4f5b-968d-4e97-b526-6ebabaccaa38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1742 microversion: 2.20 time: 0.263178 Feb 04 18:05:38.814316 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 340/679] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:38 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1742 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:05:38.816326 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 340/680] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:38 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:38.832517 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-3e2b8653-ecbd-441f-adea-f009a196527a tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:38.833330 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-3e2b8653-ecbd-441f-adea-f009a196527a tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:38.839918 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3e2b8653-ecbd-441f-adea-f009a196527a tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:38.840542 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3e2b8653-ecbd-441f-adea-f009a196527a tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:38.841483 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3e2b8653-ecbd-441f-adea-f009a196527a tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:38.842111 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3e2b8653-ecbd-441f-adea-f009a196527a tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:38.987885 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-3e2b8653-ecbd-441f-adea-f009a196527a tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:39.001705 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-3e2b8653-ecbd-441f-adea-f009a196527a tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1312 microversion: 2.1 time: 0.172423 Feb 04 18:05:39.002778 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 341/681] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:38 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1312 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:39.427579 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-e583b2b7-ffa1-4775-8e7f-307115b22bfa req-6790677d-211a-4d5a-b5f1-851a5b6fa65f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "629aebef-875d-4e7d-b9e6-ab8e0195d62c", "tag": "b2d5a9ae-dcf1-4e21-87cf-e3e8e1606141"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:05:39.432873 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:05:39.432873 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:05:39.451055 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-e583b2b7-ffa1-4775-8e7f-307115b22bfa req-6790677d-211a-4d5a-b5f1-851a5b6fa65f service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:39.452177 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-e583b2b7-ffa1-4775-8e7f-307115b22bfa req-6790677d-211a-4d5a-b5f1-851a5b6fa65f service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:39.477290 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-e583b2b7-ffa1-4775-8e7f-307115b22bfa req-6790677d-211a-4d5a-b5f1-851a5b6fa65f service nova] Creating event network-changed:b2d5a9ae-dcf1-4e21-87cf-e3e8e1606141 for instance 629aebef-875d-4e7d-b9e6-ab8e0195d62c on hv-cinder-82276 Feb 04 18:05:39.486784 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-e583b2b7-ffa1-4775-8e7f-307115b22bfa req-6790677d-211a-4d5a-b5f1-851a5b6fa65f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066460 Feb 04 18:05:39.488013 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 341/682] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:05:39.823077 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-25ef0766-f64e-416c-8678-f8686200d788 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:39.823688 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-25ef0766-f64e-416c-8678-f8686200d788 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:39.831363 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-25ef0766-f64e-416c-8678-f8686200d788 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:39.832145 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-25ef0766-f64e-416c-8678-f8686200d788 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:39.833116 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-25ef0766-f64e-416c-8678-f8686200d788 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:39.833559 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-25ef0766-f64e-416c-8678-f8686200d788 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:39.834190 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-ba6d880e-919f-45d4-867a-7bd99c3f0a4c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:39.834925 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-ba6d880e-919f-45d4-867a-7bd99c3f0a4c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:39.843873 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ba6d880e-919f-45d4-867a-7bd99c3f0a4c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:39.844335 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ba6d880e-919f-45d4-867a-7bd99c3f0a4c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:39.851127 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ba6d880e-919f-45d4-867a-7bd99c3f0a4c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:39.851127 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ba6d880e-919f-45d4-867a-7bd99c3f0a4c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:40.038878 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-25ef0766-f64e-416c-8678-f8686200d788 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:40.046947 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-25ef0766-f64e-416c-8678-f8686200d788 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1362 microversion: 2.1 time: 0.228006 Feb 04 18:05:40.047929 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 342/683] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:39 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:40.052570 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-0c1388ae-6772-43d3-a14d-0e3bac33664c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:40.053448 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-0c1388ae-6772-43d3-a14d-0e3bac33664c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:40.059617 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0c1388ae-6772-43d3-a14d-0e3bac33664c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:40.060075 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0c1388ae-6772-43d3-a14d-0e3bac33664c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:40.061153 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0c1388ae-6772-43d3-a14d-0e3bac33664c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:40.061725 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0c1388ae-6772-43d3-a14d-0e3bac33664c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:40.070758 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ba6d880e-919f-45d4-867a-7bd99c3f0a4c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:40.080525 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ba6d880e-919f-45d4-867a-7bd99c3f0a4c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:40.084934 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ba6d880e-919f-45d4-867a-7bd99c3f0a4c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:40.091854 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-ba6d880e-919f-45d4-867a-7bd99c3f0a4c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1742 microversion: 2.20 time: 0.262818 Feb 04 18:05:40.093524 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 342/684] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:39 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1742 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:05:40.221468 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-0c1388ae-6772-43d3-a14d-0e3bac33664c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:40.229147 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-0c1388ae-6772-43d3-a14d-0e3bac33664c tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1312 microversion: 2.1 time: 0.179827 Feb 04 18:05:40.229723 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 343/685] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:40 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1312 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:40.823315 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-387c64fc-6743-4db1-b273-a51f346bb0ce req-1af9b9fa-62f4-4205-b2a2-2d32b677587f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514ca883-72d2-4695-a4b6-47c18ce4add5", "name": "network-vif-plugged", "status": "completed", "tag": "fe3cfe16-c9c7-4dcd-a6bf-b32b9ba77df0"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:05:40.825337 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:05:40.825337 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:05:40.834005 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-387c64fc-6743-4db1-b273-a51f346bb0ce req-1af9b9fa-62f4-4205-b2a2-2d32b677587f service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:40.834810 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-387c64fc-6743-4db1-b273-a51f346bb0ce req-1af9b9fa-62f4-4205-b2a2-2d32b677587f service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:40.846549 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-387c64fc-6743-4db1-b273-a51f346bb0ce req-1af9b9fa-62f4-4205-b2a2-2d32b677587f service nova] Creating event network-vif-plugged:fe3cfe16-c9c7-4dcd-a6bf-b32b9ba77df0 for instance 514ca883-72d2-4695-a4b6-47c18ce4add5 on hv-cinder-82276 Feb 04 18:05:40.851477 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-387c64fc-6743-4db1-b273-a51f346bb0ce req-1af9b9fa-62f4-4205-b2a2-2d32b677587f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032893 Feb 04 18:05:40.852285 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 343/686] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:05:41.063208 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-83fb201a-0706-4394-b00c-b820a3135198 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:41.063734 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-83fb201a-0706-4394-b00c-b820a3135198 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:41.070041 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-83fb201a-0706-4394-b00c-b820a3135198 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:41.070549 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-83fb201a-0706-4394-b00c-b820a3135198 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:41.071331 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-83fb201a-0706-4394-b00c-b820a3135198 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:41.071774 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-83fb201a-0706-4394-b00c-b820a3135198 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:41.111555 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-502e6c58-c723-409e-af21-5a039b1e9d0a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:41.112288 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-502e6c58-c723-409e-af21-5a039b1e9d0a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:41.119337 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-502e6c58-c723-409e-af21-5a039b1e9d0a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:41.120886 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-502e6c58-c723-409e-af21-5a039b1e9d0a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:41.120886 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-502e6c58-c723-409e-af21-5a039b1e9d0a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:41.121192 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-502e6c58-c723-409e-af21-5a039b1e9d0a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:41.318388 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-83fb201a-0706-4394-b00c-b820a3135198 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:41.323294 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-502e6c58-c723-409e-af21-5a039b1e9d0a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:41.326179 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-83fb201a-0706-4394-b00c-b820a3135198 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1362 microversion: 2.1 time: 0.267153 Feb 04 18:05:41.326886 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 344/687] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:41 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1362 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:41.331385 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-622e3473-a252-4a90-8f79-cf4d91cdbfda tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:41.331996 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-622e3473-a252-4a90-8f79-cf4d91cdbfda tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:41.337934 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-622e3473-a252-4a90-8f79-cf4d91cdbfda tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:41.338469 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-622e3473-a252-4a90-8f79-cf4d91cdbfda tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:41.339248 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-622e3473-a252-4a90-8f79-cf4d91cdbfda tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:41.339746 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-622e3473-a252-4a90-8f79-cf4d91cdbfda tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:41.342758 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-502e6c58-c723-409e-af21-5a039b1e9d0a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:41.344268 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-502e6c58-c723-409e-af21-5a039b1e9d0a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:41.345437 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-502e6c58-c723-409e-af21-5a039b1e9d0a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1742 microversion: 2.20 time: 0.238217 Feb 04 18:05:41.346003 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 344/688] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:41 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1742 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:05:41.479398 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-622e3473-a252-4a90-8f79-cf4d91cdbfda tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:41.487248 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-622e3473-a252-4a90-8f79-cf4d91cdbfda tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1312 microversion: 2.1 time: 0.159262 Feb 04 18:05:41.487833 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 345/689] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:41 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:42.342258 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-d44d4661-b42b-48ed-80ed-dcaa6aa2fcf2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:42.343834 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-d44d4661-b42b-48ed-80ed-dcaa6aa2fcf2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:42.350701 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d44d4661-b42b-48ed-80ed-dcaa6aa2fcf2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:42.351861 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d44d4661-b42b-48ed-80ed-dcaa6aa2fcf2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:42.352276 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d44d4661-b42b-48ed-80ed-dcaa6aa2fcf2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:42.352892 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d44d4661-b42b-48ed-80ed-dcaa6aa2fcf2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:42.364191 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-45709fb3-60a5-40ee-9bae-f75e5c0cb511 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:42.364833 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-45709fb3-60a5-40ee-9bae-f75e5c0cb511 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:42.373566 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-45709fb3-60a5-40ee-9bae-f75e5c0cb511 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:42.375292 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-45709fb3-60a5-40ee-9bae-f75e5c0cb511 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:42.376291 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-45709fb3-60a5-40ee-9bae-f75e5c0cb511 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:42.376940 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-45709fb3-60a5-40ee-9bae-f75e5c0cb511 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:42.587717 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-45709fb3-60a5-40ee-9bae-f75e5c0cb511 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:42.589302 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-d44d4661-b42b-48ed-80ed-dcaa6aa2fcf2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:42.603777 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-45709fb3-60a5-40ee-9bae-f75e5c0cb511 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:42.605513 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-45709fb3-60a5-40ee-9bae-f75e5c0cb511 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:42.606830 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-45709fb3-60a5-40ee-9bae-f75e5c0cb511 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1737 microversion: 2.20 time: 0.246935 Feb 04 18:05:42.615676 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-d44d4661-b42b-48ed-80ed-dcaa6aa2fcf2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1362 microversion: 2.1 time: 0.268178 Feb 04 18:05:42.615676 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 345/691] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:42 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1362 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:42.615897 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 346/691] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:42 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1737 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:05:42.622592 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-9fe9e813-7ee9-45e5-8645-41296837d079 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:42.623306 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-9fe9e813-7ee9-45e5-8645-41296837d079 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:42.630919 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9fe9e813-7ee9-45e5-8645-41296837d079 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:42.631869 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9fe9e813-7ee9-45e5-8645-41296837d079 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:42.636356 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9fe9e813-7ee9-45e5-8645-41296837d079 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:42.636356 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9fe9e813-7ee9-45e5-8645-41296837d079 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:42.788492 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-9fe9e813-7ee9-45e5-8645-41296837d079 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:42.796297 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-9fe9e813-7ee9-45e5-8645-41296837d079 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1312 microversion: 2.1 time: 0.187773 Feb 04 18:05:42.796847 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 346/692] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:42 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1312 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:42.880017 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-53d30cb3-2ac8-413e-9260-9c55230705d4 req-46642d54-73ea-42d4-8eea-6788ada0d86c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c749413-8ac1-41ed-a2e4-880b92af98ca", "name": "network-vif-plugged", "status": "completed", "tag": "486f07de-480b-4797-b2c8-3e28685a48b6"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:05:42.882022 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:05:42.882022 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:05:42.889002 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-53d30cb3-2ac8-413e-9260-9c55230705d4 req-46642d54-73ea-42d4-8eea-6788ada0d86c service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:42.890052 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-53d30cb3-2ac8-413e-9260-9c55230705d4 req-46642d54-73ea-42d4-8eea-6788ada0d86c service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:42.900915 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-53d30cb3-2ac8-413e-9260-9c55230705d4 req-46642d54-73ea-42d4-8eea-6788ada0d86c service nova] Creating event network-vif-plugged:486f07de-480b-4797-b2c8-3e28685a48b6 for instance 7c749413-8ac1-41ed-a2e4-880b92af98ca on hv-cinder-82276 Feb 04 18:05:42.906671 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-53d30cb3-2ac8-413e-9260-9c55230705d4 req-46642d54-73ea-42d4-8eea-6788ada0d86c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030262 Feb 04 18:05:42.907378 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 347/693] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:05:43.631219 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-0697d6b5-6562-4eaf-9ae6-85983bc6fa37 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:43.632458 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-0697d6b5-6562-4eaf-9ae6-85983bc6fa37 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:43.641483 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0697d6b5-6562-4eaf-9ae6-85983bc6fa37 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:43.642252 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0697d6b5-6562-4eaf-9ae6-85983bc6fa37 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:43.643080 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0697d6b5-6562-4eaf-9ae6-85983bc6fa37 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:43.643708 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0697d6b5-6562-4eaf-9ae6-85983bc6fa37 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:43.645779 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b215d84f-2be2-4356-976c-23049370941e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:43.647554 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-b215d84f-2be2-4356-976c-23049370941e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:43.672195 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b215d84f-2be2-4356-976c-23049370941e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:43.676189 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b215d84f-2be2-4356-976c-23049370941e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:43.678017 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b215d84f-2be2-4356-976c-23049370941e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:43.680173 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b215d84f-2be2-4356-976c-23049370941e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:43.871658 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-0697d6b5-6562-4eaf-9ae6-85983bc6fa37 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:43.882801 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-0697d6b5-6562-4eaf-9ae6-85983bc6fa37 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1362 microversion: 2.1 time: 0.256991 Feb 04 18:05:43.884076 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 347/694] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:43 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:43.889588 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-25180729-88c5-4130-bdec-4d0df6edf916 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:43.893131 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-25180729-88c5-4130-bdec-4d0df6edf916 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:43.903265 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-25180729-88c5-4130-bdec-4d0df6edf916 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:43.904346 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-25180729-88c5-4130-bdec-4d0df6edf916 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:43.905937 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-25180729-88c5-4130-bdec-4d0df6edf916 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:43.906519 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-25180729-88c5-4130-bdec-4d0df6edf916 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:44.212055 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-25180729-88c5-4130-bdec-4d0df6edf916 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:44.234776 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-25180729-88c5-4130-bdec-4d0df6edf916 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1312 microversion: 2.1 time: 0.334923 Feb 04 18:05:44.234776 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 348/695] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:43 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1312 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:44.235284 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-b215d84f-2be2-4356-976c-23049370941e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:44.235284 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-b215d84f-2be2-4356-976c-23049370941e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:44.235521 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-b215d84f-2be2-4356-976c-23049370941e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:44.236803 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-b215d84f-2be2-4356-976c-23049370941e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1737 microversion: 2.20 time: 0.602562 Feb 04 18:05:44.255219 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 348/696] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:43 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1737 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:05:44.493747 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a0e1092c-b0e0-4b72-9737-be7d3a2971dc tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:44.494471 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-a0e1092c-b0e0-4b72-9737-be7d3a2971dc tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:44.502100 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a0e1092c-b0e0-4b72-9737-be7d3a2971dc tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:44.502825 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a0e1092c-b0e0-4b72-9737-be7d3a2971dc tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:44.504481 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a0e1092c-b0e0-4b72-9737-be7d3a2971dc tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:44.505582 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a0e1092c-b0e0-4b72-9737-be7d3a2971dc tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:44.659636 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.objects.instance [None req-a0e1092c-b0e0-4b72-9737-be7d3a2971dc tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lazy-loading 'services' on Instance uuid 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e {{(pid=123567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:05:44.900965 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-cb79183e-fe01-47fb-adf4-850684cf9ac4 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:44.911998 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-cb79183e-fe01-47fb-adf4-850684cf9ac4 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:44.911998 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cb79183e-fe01-47fb-adf4-850684cf9ac4 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:44.911998 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cb79183e-fe01-47fb-adf4-850684cf9ac4 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:44.911998 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cb79183e-fe01-47fb-adf4-850684cf9ac4 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:44.912383 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cb79183e-fe01-47fb-adf4-850684cf9ac4 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:45.041438 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a0e1092c-b0e0-4b72-9737-be7d3a2971dc tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "DELETE /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e/os-volume_attachments/637c3cf6-09de-4d6b-bec1-ea8cf0f91427" status: 202 len: 0 microversion: 2.1 time: 0.552975 Feb 04 18:05:45.049609 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 349/697] 10.222.0.98 () {58 vars in 1415 bytes} [Fri Feb 4 18:05:44 2022] DELETE /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e/os-volume_attachments/637c3cf6-09de-4d6b-bec1-ea8cf0f91427 => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 04 18:05:45.117849 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-cb79183e-fe01-47fb-adf4-850684cf9ac4 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:45.126795 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-cb79183e-fe01-47fb-adf4-850684cf9ac4 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1362 microversion: 2.1 time: 0.229478 Feb 04 18:05:45.137142 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 349/698] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:44 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:05:45.252803 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e350712e-0b4c-4dd1-9b29-7e31048347b2 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:45.253565 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-e350712e-0b4c-4dd1-9b29-7e31048347b2 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:45.261634 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e350712e-0b4c-4dd1-9b29-7e31048347b2 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:45.262344 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e350712e-0b4c-4dd1-9b29-7e31048347b2 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:45.263915 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e350712e-0b4c-4dd1-9b29-7e31048347b2 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:45.265591 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-411a257a-f613-480b-a3a9-e33539696c26 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:45.266314 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e350712e-0b4c-4dd1-9b29-7e31048347b2 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:45.266624 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-411a257a-f613-480b-a3a9-e33539696c26 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:45.273249 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-411a257a-f613-480b-a3a9-e33539696c26 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:45.274149 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-411a257a-f613-480b-a3a9-e33539696c26 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:45.275206 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-411a257a-f613-480b-a3a9-e33539696c26 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:45.275844 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-411a257a-f613-480b-a3a9-e33539696c26 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:45.488586 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-411a257a-f613-480b-a3a9-e33539696c26 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:45.497482 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-411a257a-f613-480b-a3a9-e33539696c26 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:45.500438 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-411a257a-f613-480b-a3a9-e33539696c26 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:45.501983 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-411a257a-f613-480b-a3a9-e33539696c26 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1737 microversion: 2.20 time: 0.241807 Feb 04 18:05:45.502580 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 350/699] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:45 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1737 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:05:45.536810 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e350712e-0b4c-4dd1-9b29-7e31048347b2 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:45.549341 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e350712e-0b4c-4dd1-9b29-7e31048347b2 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1312 microversion: 2.1 time: 0.302519 Feb 04 18:05:45.550447 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 350/700] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:45 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1312 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:46.149764 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-5423843c-ea53-425c-975e-93e8816d57b4 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:46.150526 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-5423843c-ea53-425c-975e-93e8816d57b4 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:46.157828 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5423843c-ea53-425c-975e-93e8816d57b4 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:46.158287 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5423843c-ea53-425c-975e-93e8816d57b4 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:46.159276 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5423843c-ea53-425c-975e-93e8816d57b4 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:46.159716 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5423843c-ea53-425c-975e-93e8816d57b4 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:46.330053 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-5423843c-ea53-425c-975e-93e8816d57b4 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:46.337272 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-5423843c-ea53-425c-975e-93e8816d57b4 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1362 microversion: 2.1 time: 0.192154 Feb 04 18:05:46.337834 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 351/701] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:46 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:46.520244 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c9f80d93-f5a7-469b-9aff-d645ef6cfcb3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:46.520980 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c9f80d93-f5a7-469b-9aff-d645ef6cfcb3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:46.527210 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c9f80d93-f5a7-469b-9aff-d645ef6cfcb3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:46.527672 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c9f80d93-f5a7-469b-9aff-d645ef6cfcb3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:46.528451 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c9f80d93-f5a7-469b-9aff-d645ef6cfcb3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:46.528908 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c9f80d93-f5a7-469b-9aff-d645ef6cfcb3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:46.566530 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-4442d210-f9ac-4fa8-a2bb-002d6ac5d079 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:46.567161 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-4442d210-f9ac-4fa8-a2bb-002d6ac5d079 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:46.573286 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4442d210-f9ac-4fa8-a2bb-002d6ac5d079 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:46.573734 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4442d210-f9ac-4fa8-a2bb-002d6ac5d079 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:46.574774 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4442d210-f9ac-4fa8-a2bb-002d6ac5d079 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:46.575384 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4442d210-f9ac-4fa8-a2bb-002d6ac5d079 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:46.750901 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c9f80d93-f5a7-469b-9aff-d645ef6cfcb3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:46.761359 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c9f80d93-f5a7-469b-9aff-d645ef6cfcb3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:46.766317 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c9f80d93-f5a7-469b-9aff-d645ef6cfcb3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:46.767553 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c9f80d93-f5a7-469b-9aff-d645ef6cfcb3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1737 microversion: 2.20 time: 0.251108 Feb 04 18:05:46.768124 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 351/702] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:46 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1737 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:05:46.821677 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-4442d210-f9ac-4fa8-a2bb-002d6ac5d079 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:46.830884 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-4442d210-f9ac-4fa8-a2bb-002d6ac5d079 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1312 microversion: 2.1 time: 0.267848 Feb 04 18:05:46.831493 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 352/703] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:46 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1312 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:05:47.243238 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-421fa87b-f040-4d9c-a271-65830f3133ec tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:47.243901 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-421fa87b-f040-4d9c-a271-65830f3133ec tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:47.252096 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-421fa87b-f040-4d9c-a271-65830f3133ec tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:47.252628 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-421fa87b-f040-4d9c-a271-65830f3133ec tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:47.253556 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-421fa87b-f040-4d9c-a271-65830f3133ec tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:47.254066 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-421fa87b-f040-4d9c-a271-65830f3133ec tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:47.279479 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-421fa87b-f040-4d9c-a271-65830f3133ec tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Going to try to terminate instance {{(pid=123567) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 04 18:05:47.361258 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-0bc5516e-fa23-4749-88a4-9edcfe82b4b2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:47.362529 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-0bc5516e-fa23-4749-88a4-9edcfe82b4b2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:47.369713 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0bc5516e-fa23-4749-88a4-9edcfe82b4b2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:47.370540 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0bc5516e-fa23-4749-88a4-9edcfe82b4b2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:47.371324 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0bc5516e-fa23-4749-88a4-9edcfe82b4b2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:47.371929 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0bc5516e-fa23-4749-88a4-9edcfe82b4b2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:47.514527 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-0bc5516e-fa23-4749-88a4-9edcfe82b4b2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:47.522657 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-0bc5516e-fa23-4749-88a4-9edcfe82b4b2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1362 microversion: 2.1 time: 0.165985 Feb 04 18:05:47.524852 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 353/704] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:47 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:47.622314 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-421fa87b-f040-4d9c-a271-65830f3133ec tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "DELETE /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 204 len: 0 microversion: 2.1 time: 0.382886 Feb 04 18:05:47.623048 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 352/705] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Feb 4 18:05:47 2022] DELETE /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 04 18:05:47.631155 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-27b9bf21-f597-4d6c-994d-75de8faf66d2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:47.631879 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-27b9bf21-f597-4d6c-994d-75de8faf66d2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:47.638289 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-27b9bf21-f597-4d6c-994d-75de8faf66d2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:47.638791 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-27b9bf21-f597-4d6c-994d-75de8faf66d2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:47.639668 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-27b9bf21-f597-4d6c-994d-75de8faf66d2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:47.640113 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-27b9bf21-f597-4d6c-994d-75de8faf66d2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:47.789103 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-aba49c98-45d6-4ca4-8e84-e7dc508b8794 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:47.790037 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-aba49c98-45d6-4ca4-8e84-e7dc508b8794 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:47.806809 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-aba49c98-45d6-4ca4-8e84-e7dc508b8794 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:47.807276 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-aba49c98-45d6-4ca4-8e84-e7dc508b8794 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:47.811560 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-aba49c98-45d6-4ca4-8e84-e7dc508b8794 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:47.812291 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-aba49c98-45d6-4ca4-8e84-e7dc508b8794 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:47.883829 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-27b9bf21-f597-4d6c-994d-75de8faf66d2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:47.895637 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-27b9bf21-f597-4d6c-994d-75de8faf66d2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1513 microversion: 2.1 time: 0.268084 Feb 04 18:05:47.896241 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 354/706] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:47 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1513 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:47.901482 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-6570a0a0-5f54-485f-82e1-e75d586175d1 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:47.902116 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-6570a0a0-5f54-485f-82e1-e75d586175d1 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:47.919828 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6570a0a0-5f54-485f-82e1-e75d586175d1 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:47.923564 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6570a0a0-5f54-485f-82e1-e75d586175d1 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:47.923871 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6570a0a0-5f54-485f-82e1-e75d586175d1 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:47.924677 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6570a0a0-5f54-485f-82e1-e75d586175d1 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:48.098452 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-aba49c98-45d6-4ca4-8e84-e7dc508b8794 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:48.107001 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-aba49c98-45d6-4ca4-8e84-e7dc508b8794 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:48.108658 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-aba49c98-45d6-4ca4-8e84-e7dc508b8794 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:48.109874 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-aba49c98-45d6-4ca4-8e84-e7dc508b8794 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1737 microversion: 2.20 time: 0.327027 Feb 04 18:05:48.110490 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 353/707] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:47 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1737 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:05:48.138822 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-6570a0a0-5f54-485f-82e1-e75d586175d1 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:48.148270 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-6570a0a0-5f54-485f-82e1-e75d586175d1 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1495 microversion: 2.1 time: 0.250114 Feb 04 18:05:48.149460 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 355/708] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:47 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1495 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:48.541061 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-bd5bf083-05ca-4bf5-93a7-d59a89f37ea6 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:48.545343 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-bd5bf083-05ca-4bf5-93a7-d59a89f37ea6 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:48.550909 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bd5bf083-05ca-4bf5-93a7-d59a89f37ea6 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:48.551375 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bd5bf083-05ca-4bf5-93a7-d59a89f37ea6 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:48.552211 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bd5bf083-05ca-4bf5-93a7-d59a89f37ea6 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:48.552211 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bd5bf083-05ca-4bf5-93a7-d59a89f37ea6 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:48.805462 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-bd5bf083-05ca-4bf5-93a7-d59a89f37ea6 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:48.819086 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-bd5bf083-05ca-4bf5-93a7-d59a89f37ea6 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1362 microversion: 2.1 time: 0.281798 Feb 04 18:05:48.819686 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 354/709] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:48 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:48.913598 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-8e4aad4f-d85c-4c0c-b732-4199ce745a03 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:48.914247 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-8e4aad4f-d85c-4c0c-b732-4199ce745a03 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:48.924799 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8e4aad4f-d85c-4c0c-b732-4199ce745a03 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:48.925275 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8e4aad4f-d85c-4c0c-b732-4199ce745a03 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:48.926099 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8e4aad4f-d85c-4c0c-b732-4199ce745a03 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:48.926581 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8e4aad4f-d85c-4c0c-b732-4199ce745a03 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:49.061335 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-9ce09a54-32e4-42c0-b6fa-f7a07c901454 req-78af4984-01a0-47c1-b3b0-c05752ebfe77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "629aebef-875d-4e7d-b9e6-ab8e0195d62c", "name": "network-vif-plugged", "status": "completed", "tag": "b2d5a9ae-dcf1-4e21-87cf-e3e8e1606141"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:05:49.063836 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:05:49.063836 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:05:49.075990 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-9ce09a54-32e4-42c0-b6fa-f7a07c901454 req-78af4984-01a0-47c1-b3b0-c05752ebfe77 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:49.076692 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-9ce09a54-32e4-42c0-b6fa-f7a07c901454 req-78af4984-01a0-47c1-b3b0-c05752ebfe77 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:49.090929 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-9ce09a54-32e4-42c0-b6fa-f7a07c901454 req-78af4984-01a0-47c1-b3b0-c05752ebfe77 service nova] Creating event network-vif-plugged:b2d5a9ae-dcf1-4e21-87cf-e3e8e1606141 for instance 629aebef-875d-4e7d-b9e6-ab8e0195d62c on hv-cinder-82276 Feb 04 18:05:49.099305 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-9ce09a54-32e4-42c0-b6fa-f7a07c901454 req-78af4984-01a0-47c1-b3b0-c05752ebfe77 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043630 Feb 04 18:05:49.100301 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 355/710] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:05:49.138024 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-9a8462f7-ffe1-4769-9912-37e4c75a5124 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:49.145077 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-8e4aad4f-d85c-4c0c-b732-4199ce745a03 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:49.146593 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-9a8462f7-ffe1-4769-9912-37e4c75a5124 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:49.154546 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9a8462f7-ffe1-4769-9912-37e4c75a5124 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:49.155890 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9a8462f7-ffe1-4769-9912-37e4c75a5124 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:49.156687 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9a8462f7-ffe1-4769-9912-37e4c75a5124 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:49.157181 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9a8462f7-ffe1-4769-9912-37e4c75a5124 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:49.158106 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-8e4aad4f-d85c-4c0c-b732-4199ce745a03 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1513 microversion: 2.1 time: 0.248910 Feb 04 18:05:49.163231 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 356/711] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:48 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1513 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:49.323499 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-9a8462f7-ffe1-4769-9912-37e4c75a5124 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:49.332280 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-9a8462f7-ffe1-4769-9912-37e4c75a5124 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:49.334813 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-9a8462f7-ffe1-4769-9912-37e4c75a5124 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:49.336271 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-9a8462f7-ffe1-4769-9912-37e4c75a5124 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1737 microversion: 2.20 time: 0.202492 Feb 04 18:05:49.347008 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 356/712] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:49 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1737 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:05:49.405348 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-06d1f833-91d0-4447-aa5e-418174f18255 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:49.406589 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-06d1f833-91d0-4447-aa5e-418174f18255 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:49.418397 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-06d1f833-91d0-4447-aa5e-418174f18255 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:49.419021 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-06d1f833-91d0-4447-aa5e-418174f18255 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:49.420387 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-06d1f833-91d0-4447-aa5e-418174f18255 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:49.421068 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-06d1f833-91d0-4447-aa5e-418174f18255 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:49.455615 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-06d1f833-91d0-4447-aa5e-418174f18255 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Going to try to terminate instance {{(pid=123566) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 04 18:05:49.840158 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-fb2efbfb-66dd-4f6f-8083-961de408da8c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:49.840978 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-fb2efbfb-66dd-4f6f-8083-961de408da8c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:49.849627 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fb2efbfb-66dd-4f6f-8083-961de408da8c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:49.850082 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fb2efbfb-66dd-4f6f-8083-961de408da8c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:49.850926 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fb2efbfb-66dd-4f6f-8083-961de408da8c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:49.852521 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fb2efbfb-66dd-4f6f-8083-961de408da8c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:50.247756 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-fb2efbfb-66dd-4f6f-8083-961de408da8c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:50.255069 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-fb2efbfb-66dd-4f6f-8083-961de408da8c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1362 microversion: 2.1 time: 0.420563 Feb 04 18:05:50.255909 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 357/713] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:49 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1362 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:05:50.260299 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e69f5eb1-9329-4c9b-ae26-fabef53619a2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:50.260904 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-e69f5eb1-9329-4c9b-ae26-fabef53619a2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:50.266949 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e69f5eb1-9329-4c9b-ae26-fabef53619a2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:50.267404 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e69f5eb1-9329-4c9b-ae26-fabef53619a2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:50.268189 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e69f5eb1-9329-4c9b-ae26-fabef53619a2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:50.268629 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e69f5eb1-9329-4c9b-ae26-fabef53619a2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:50.418708 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e69f5eb1-9329-4c9b-ae26-fabef53619a2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:50.426771 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e69f5eb1-9329-4c9b-ae26-fabef53619a2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1513 microversion: 2.1 time: 0.169760 Feb 04 18:05:50.427422 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 358/714] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:50 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:50.431820 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-d0a79521-b197-4804-bfc9-932fb46bf89a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:50.443571 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-d0a79521-b197-4804-bfc9-932fb46bf89a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:50.443571 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d0a79521-b197-4804-bfc9-932fb46bf89a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:50.443571 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d0a79521-b197-4804-bfc9-932fb46bf89a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:50.443571 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d0a79521-b197-4804-bfc9-932fb46bf89a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:50.443971 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d0a79521-b197-4804-bfc9-932fb46bf89a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:50.576683 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-d0a79521-b197-4804-bfc9-932fb46bf89a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:50.584258 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-d0a79521-b197-4804-bfc9-932fb46bf89a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:50.585732 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-d0a79521-b197-4804-bfc9-932fb46bf89a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:50.586897 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-d0a79521-b197-4804-bfc9-932fb46bf89a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1737 microversion: 2.20 time: 0.158572 Feb 04 18:05:50.587709 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 359/715] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:50 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:05:50.681067 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-06d1f833-91d0-4447-aa5e-418174f18255 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "DELETE /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 204 len: 0 microversion: 2.1 time: 1.281355 Feb 04 18:05:50.681705 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 357/716] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Feb 4 18:05:49 2022] DELETE /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 0 bytes in 1283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 04 18:05:50.689938 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-51a48a3c-5fe6-4e33-8b2a-0bdffb1d9a73 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:50.695635 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-51a48a3c-5fe6-4e33-8b2a-0bdffb1d9a73 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:50.701666 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-51a48a3c-5fe6-4e33-8b2a-0bdffb1d9a73 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:50.702116 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-51a48a3c-5fe6-4e33-8b2a-0bdffb1d9a73 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:50.702942 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-51a48a3c-5fe6-4e33-8b2a-0bdffb1d9a73 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:50.703381 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-51a48a3c-5fe6-4e33-8b2a-0bdffb1d9a73 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:50.872282 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-51a48a3c-5fe6-4e33-8b2a-0bdffb1d9a73 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:50.880328 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-51a48a3c-5fe6-4e33-8b2a-0bdffb1d9a73 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1501 microversion: 2.1 time: 0.194092 Feb 04 18:05:50.880903 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 360/717] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:50 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1501 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:51.275072 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-56d4fec8-7aa0-426c-a62e-65a7030c7a47 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:51.283405 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-56d4fec8-7aa0-426c-a62e-65a7030c7a47 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:51.291697 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-56d4fec8-7aa0-426c-a62e-65a7030c7a47 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:51.292409 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-56d4fec8-7aa0-426c-a62e-65a7030c7a47 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:51.293818 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-56d4fec8-7aa0-426c-a62e-65a7030c7a47 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:51.297300 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-56d4fec8-7aa0-426c-a62e-65a7030c7a47 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:51.445146 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-8782c4d3-e5f3-4513-8edd-2a842c6a450e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:51.459071 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-8782c4d3-e5f3-4513-8edd-2a842c6a450e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:51.461300 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8782c4d3-e5f3-4513-8edd-2a842c6a450e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:51.462054 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8782c4d3-e5f3-4513-8edd-2a842c6a450e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:51.466807 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8782c4d3-e5f3-4513-8edd-2a842c6a450e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:51.468711 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8782c4d3-e5f3-4513-8edd-2a842c6a450e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:51.513290 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-56d4fec8-7aa0-426c-a62e-65a7030c7a47 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:51.525494 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-56d4fec8-7aa0-426c-a62e-65a7030c7a47 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1362 microversion: 2.1 time: 0.256376 Feb 04 18:05:51.530887 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 358/718] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:51 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:51.541157 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-1575590e-be75-4b9d-83a0-6828bcd465bd req-818b36d2-f191-4bb9-9ae5-d5fdf5fc35df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f430b1-a5fe-4f64-9b18-fdcc004bfd4e", "name": "network-vif-deleted", "tag": "9be7a7bb-43f1-4a15-908b-750308500bc3"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:05:51.543280 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:05:51.543280 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:05:51.551742 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-1575590e-be75-4b9d-83a0-6828bcd465bd req-818b36d2-f191-4bb9-9ae5-d5fdf5fc35df service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:51.552443 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-1575590e-be75-4b9d-83a0-6828bcd465bd req-818b36d2-f191-4bb9-9ae5-d5fdf5fc35df service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:51.567734 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-1575590e-be75-4b9d-83a0-6828bcd465bd req-818b36d2-f191-4bb9-9ae5-d5fdf5fc35df service nova] Creating event network-vif-deleted:9be7a7bb-43f1-4a15-908b-750308500bc3 for instance 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e on hv-cinder-82276 Feb 04 18:05:51.573069 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-1575590e-be75-4b9d-83a0-6828bcd465bd req-818b36d2-f191-4bb9-9ae5-d5fdf5fc35df service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040610 Feb 04 18:05:51.574265 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 359/719] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:05:51.575200 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-8782c4d3-e5f3-4513-8edd-2a842c6a450e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:51.585758 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-8782c4d3-e5f3-4513-8edd-2a842c6a450e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1471 microversion: 2.1 time: 0.144772 Feb 04 18:05:51.586439 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 361/720] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:51 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1471 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:05:51.610296 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-4920c32c-19a5-4c63-9948-595ee1e1ae7d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:51.612109 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-4920c32c-19a5-4c63-9948-595ee1e1ae7d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:51.624968 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4920c32c-19a5-4c63-9948-595ee1e1ae7d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:51.626331 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4920c32c-19a5-4c63-9948-595ee1e1ae7d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:51.627688 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4920c32c-19a5-4c63-9948-595ee1e1ae7d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:51.628609 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4920c32c-19a5-4c63-9948-595ee1e1ae7d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:51.843588 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-4920c32c-19a5-4c63-9948-595ee1e1ae7d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:51.853167 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-4920c32c-19a5-4c63-9948-595ee1e1ae7d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:51.854757 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-4920c32c-19a5-4c63-9948-595ee1e1ae7d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:51.856034 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-4920c32c-19a5-4c63-9948-595ee1e1ae7d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1737 microversion: 2.20 time: 0.252132 Feb 04 18:05:51.856602 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 360/721] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:51 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1737 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:05:51.896833 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3bb8ddfb-629f-4c45-8912-65d8fbf026e3 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:51.897432 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-3bb8ddfb-629f-4c45-8912-65d8fbf026e3 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:51.903522 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3bb8ddfb-629f-4c45-8912-65d8fbf026e3 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:51.904005 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3bb8ddfb-629f-4c45-8912-65d8fbf026e3 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:51.904744 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3bb8ddfb-629f-4c45-8912-65d8fbf026e3 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:51.905882 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3bb8ddfb-629f-4c45-8912-65d8fbf026e3 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:52.072745 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-3bb8ddfb-629f-4c45-8912-65d8fbf026e3 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:52.081097 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-3bb8ddfb-629f-4c45-8912-65d8fbf026e3 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1501 microversion: 2.1 time: 0.187871 Feb 04 18:05:52.091320 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 362/722] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:51 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1501 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:52.544558 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-f765a7c2-42a4-4de2-8cae-28d0b10e545b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:52.546117 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-f765a7c2-42a4-4de2-8cae-28d0b10e545b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:52.553428 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f765a7c2-42a4-4de2-8cae-28d0b10e545b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:52.554166 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f765a7c2-42a4-4de2-8cae-28d0b10e545b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:52.554976 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f765a7c2-42a4-4de2-8cae-28d0b10e545b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:52.555601 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f765a7c2-42a4-4de2-8cae-28d0b10e545b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:52.603395 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-9d411d2d-2259-40d7-a871-7bf345d310bf tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:52.604002 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-9d411d2d-2259-40d7-a871-7bf345d310bf tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:52.610814 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9d411d2d-2259-40d7-a871-7bf345d310bf tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:52.614868 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9d411d2d-2259-40d7-a871-7bf345d310bf tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:52.614868 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9d411d2d-2259-40d7-a871-7bf345d310bf tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:52.614868 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9d411d2d-2259-40d7-a871-7bf345d310bf tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:52.653940 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9d411d2d-2259-40d7-a871-7bf345d310bf tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:52.654445 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9d411d2d-2259-40d7-a871-7bf345d310bf tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:52.655045 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.objects.instance [None req-9d411d2d-2259-40d7-a871-7bf345d310bf tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lazy-loading 'fault' on Instance uuid 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e {{(pid=123567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:05:52.722160 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-9d411d2d-2259-40d7-a871-7bf345d310bf tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:52.733671 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-9d411d2d-2259-40d7-a871-7bf345d310bf tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 200 len: 1309 microversion: 2.1 time: 0.133700 Feb 04 18:05:52.734857 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 363/723] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:52 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 1309 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:52.767749 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-f765a7c2-42a4-4de2-8cae-28d0b10e545b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:52.776394 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-f765a7c2-42a4-4de2-8cae-28d0b10e545b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1548 microversion: 2.1 time: 0.235488 Feb 04 18:05:52.782052 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 361/724] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:52 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1548 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:52.794218 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-8a3d482a-790c-424a-9bd6-cefcff4b0f4c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:52.794814 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-8a3d482a-790c-424a-9bd6-cefcff4b0f4c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:52.801335 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8a3d482a-790c-424a-9bd6-cefcff4b0f4c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:52.806490 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8a3d482a-790c-424a-9bd6-cefcff4b0f4c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:52.806490 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8a3d482a-790c-424a-9bd6-cefcff4b0f4c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:52.806490 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8a3d482a-790c-424a-9bd6-cefcff4b0f4c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:52.878465 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-3c920b29-b508-4d7f-83bb-7b140d8a6915 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:52.879249 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-3c920b29-b508-4d7f-83bb-7b140d8a6915 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:52.897064 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-8a3d482a-790c-424a-9bd6-cefcff4b0f4c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106503 Feb 04 18:05:52.897611 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3c920b29-b508-4d7f-83bb-7b140d8a6915 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:52.897729 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 364/725] 10.222.0.98 () {58 vars in 1274 bytes} [Fri Feb 4 18:05:52 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:05:52.910642 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3c920b29-b508-4d7f-83bb-7b140d8a6915 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:52.912240 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3c920b29-b508-4d7f-83bb-7b140d8a6915 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:52.912843 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3c920b29-b508-4d7f-83bb-7b140d8a6915 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:53.109998 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-0240a2cf-88dd-4311-9d61-3e81e007e575 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:53.111708 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-0240a2cf-88dd-4311-9d61-3e81e007e575 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:53.127772 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0240a2cf-88dd-4311-9d61-3e81e007e575 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:53.132872 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0240a2cf-88dd-4311-9d61-3e81e007e575 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:53.134440 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0240a2cf-88dd-4311-9d61-3e81e007e575 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:53.135088 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0240a2cf-88dd-4311-9d61-3e81e007e575 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:53.573246 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-3c920b29-b508-4d7f-83bb-7b140d8a6915 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:53.587250 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-3c920b29-b508-4d7f-83bb-7b140d8a6915 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:53.590959 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-3c920b29-b508-4d7f-83bb-7b140d8a6915 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:53.597852 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-3c920b29-b508-4d7f-83bb-7b140d8a6915 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1737 microversion: 2.20 time: 0.725515 Feb 04 18:05:53.599187 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 362/726] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:52 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1737 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:05:53.611445 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-0240a2cf-88dd-4311-9d61-3e81e007e575 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:53.620158 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-0240a2cf-88dd-4311-9d61-3e81e007e575 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1501 microversion: 2.1 time: 0.515232 Feb 04 18:05:53.629739 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 365/727] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:53 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1501 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:53.758673 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-bcf63775-f41d-4745-9a9c-550ec6bb7f5b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:53.759519 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-bcf63775-f41d-4745-9a9c-550ec6bb7f5b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:53.765775 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bcf63775-f41d-4745-9a9c-550ec6bb7f5b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:53.766234 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bcf63775-f41d-4745-9a9c-550ec6bb7f5b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:53.767049 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bcf63775-f41d-4745-9a9c-550ec6bb7f5b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:53.767495 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bcf63775-f41d-4745-9a9c-550ec6bb7f5b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:53.798101 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-bcf63775-f41d-4745-9a9c-550ec6bb7f5b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] HTTP exception thrown: Instance 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e could not be found. Feb 04 18:05:53.799127 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-bcf63775-f41d-4745-9a9c-550ec6bb7f5b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Returning 404 to user: Instance 03f430b1-a5fe-4f64-9b18-fdcc004bfd4e could not be found. {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:05:53.800234 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-bcf63775-f41d-4745-9a9c-550ec6bb7f5b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e" status: 404 len: 111 microversion: 2.1 time: 0.045282 Feb 04 18:05:53.801339 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 363/728] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:53 2022] GET /compute/v2.1/servers/03f430b1-a5fe-4f64-9b18-fdcc004bfd4e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:05:54.062994 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-77cae8ea-413f-4122-aefe-f280cf7dda6e req-6d83b83e-441f-4163-8730-8cfa0058c52a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c749413-8ac1-41ed-a2e4-880b92af98ca", "name": "network-vif-deleted", "tag": "486f07de-480b-4797-b2c8-3e28685a48b6"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:05:54.065014 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:05:54.065014 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:05:54.080960 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-77cae8ea-413f-4122-aefe-f280cf7dda6e req-6d83b83e-441f-4163-8730-8cfa0058c52a service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:54.081809 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-77cae8ea-413f-4122-aefe-f280cf7dda6e req-6d83b83e-441f-4163-8730-8cfa0058c52a service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:54.094712 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-77cae8ea-413f-4122-aefe-f280cf7dda6e req-6d83b83e-441f-4163-8730-8cfa0058c52a service nova] Creating event network-vif-deleted:486f07de-480b-4797-b2c8-3e28685a48b6 for instance 7c749413-8ac1-41ed-a2e4-880b92af98ca on hv-cinder-82276 Feb 04 18:05:54.105198 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-77cae8ea-413f-4122-aefe-f280cf7dda6e req-6d83b83e-441f-4163-8730-8cfa0058c52a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046705 Feb 04 18:05:54.105815 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 366/729] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:05:54.370369 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ebc4a319-3c17-4644-8444-efa4a147afba tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:54.371719 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ebc4a319-3c17-4644-8444-efa4a147afba tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:54.383203 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-97d66794-3f6f-48cd-ad6d-b02f88b89c9c req-0578cf9a-0c36-41d5-a91f-136ad5f83208 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "629aebef-875d-4e7d-b9e6-ab8e0195d62c", "tag": "b2d5a9ae-dcf1-4e21-87cf-e3e8e1606141"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:05:54.384080 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:05:54.384080 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:05:54.401618 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ebc4a319-3c17-4644-8444-efa4a147afba tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:54.405000 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ebc4a319-3c17-4644-8444-efa4a147afba tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:54.409847 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ebc4a319-3c17-4644-8444-efa4a147afba tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:54.410639 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ebc4a319-3c17-4644-8444-efa4a147afba tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:54.412534 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-97d66794-3f6f-48cd-ad6d-b02f88b89c9c req-0578cf9a-0c36-41d5-a91f-136ad5f83208 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:54.417062 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-97d66794-3f6f-48cd-ad6d-b02f88b89c9c req-0578cf9a-0c36-41d5-a91f-136ad5f83208 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:54.456237 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-97d66794-3f6f-48cd-ad6d-b02f88b89c9c req-0578cf9a-0c36-41d5-a91f-136ad5f83208 service nova] Creating event network-changed:b2d5a9ae-dcf1-4e21-87cf-e3e8e1606141 for instance 629aebef-875d-4e7d-b9e6-ab8e0195d62c on hv-cinder-82276 Feb 04 18:05:54.462114 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-97d66794-3f6f-48cd-ad6d-b02f88b89c9c req-0578cf9a-0c36-41d5-a91f-136ad5f83208 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085015 Feb 04 18:05:54.463389 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 367/730] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:05:54.626597 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-08e1ecbd-9673-43d3-98d4-4da9985c2849 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:54.627338 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-08e1ecbd-9673-43d3-98d4-4da9985c2849 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:54.640246 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-08e1ecbd-9673-43d3-98d4-4da9985c2849 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:54.640757 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-08e1ecbd-9673-43d3-98d4-4da9985c2849 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:54.644974 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-08e1ecbd-9673-43d3-98d4-4da9985c2849 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:54.645426 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-08e1ecbd-9673-43d3-98d4-4da9985c2849 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:54.675064 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-ebc4a319-3c17-4644-8444-efa4a147afba tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:54.683772 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ebc4a319-3c17-4644-8444-efa4a147afba tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1548 microversion: 2.1 time: 0.317651 Feb 04 18:05:54.684363 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 364/731] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:54 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1548 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:54.692429 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-74dd5cd4-596f-4290-9ba1-84235b7b034e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:54.698892 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-74dd5cd4-596f-4290-9ba1-84235b7b034e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:54.712677 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-74dd5cd4-596f-4290-9ba1-84235b7b034e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:54.713272 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-74dd5cd4-596f-4290-9ba1-84235b7b034e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:54.714388 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-74dd5cd4-596f-4290-9ba1-84235b7b034e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:54.714945 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-74dd5cd4-596f-4290-9ba1-84235b7b034e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:54.757839 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-74dd5cd4-596f-4290-9ba1-84235b7b034e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:54.758487 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-74dd5cd4-596f-4290-9ba1-84235b7b034e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:54.759323 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.objects.instance [None req-74dd5cd4-596f-4290-9ba1-84235b7b034e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lazy-loading 'fault' on Instance uuid 7c749413-8ac1-41ed-a2e4-880b92af98ca {{(pid=123566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:05:54.854674 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-74dd5cd4-596f-4290-9ba1-84235b7b034e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:54.867552 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-74dd5cd4-596f-4290-9ba1-84235b7b034e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1302 microversion: 2.1 time: 0.176459 Feb 04 18:05:54.868528 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 365/732] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:54 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1302 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:54.871971 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-08e1ecbd-9673-43d3-98d4-4da9985c2849 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:54.881542 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-08e1ecbd-9673-43d3-98d4-4da9985c2849 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:54.886572 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-08e1ecbd-9673-43d3-98d4-4da9985c2849 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:54.890198 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-08e1ecbd-9673-43d3-98d4-4da9985c2849 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1737 microversion: 2.20 time: 0.276799 Feb 04 18:05:54.893487 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 368/733] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:54 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1737 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:05:55.703604 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-50e8b2e0-f607-4d67-af1d-901b20489517 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:55.704211 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-50e8b2e0-f607-4d67-af1d-901b20489517 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:55.710790 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-50e8b2e0-f607-4d67-af1d-901b20489517 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:55.711334 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-50e8b2e0-f607-4d67-af1d-901b20489517 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:55.712233 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-50e8b2e0-f607-4d67-af1d-901b20489517 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:55.712757 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-50e8b2e0-f607-4d67-af1d-901b20489517 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:55.861002 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-50e8b2e0-f607-4d67-af1d-901b20489517 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:55.868718 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-50e8b2e0-f607-4d67-af1d-901b20489517 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1548 microversion: 2.1 time: 0.168918 Feb 04 18:05:55.869300 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 366/734] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:55 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:55.891875 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-dc177581-795e-4351-b91b-7e28e27794e5 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:55.892514 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-dc177581-795e-4351-b91b-7e28e27794e5 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:55.899152 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dc177581-795e-4351-b91b-7e28e27794e5 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:55.899599 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dc177581-795e-4351-b91b-7e28e27794e5 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:55.900377 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dc177581-795e-4351-b91b-7e28e27794e5 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:55.900813 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dc177581-795e-4351-b91b-7e28e27794e5 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:55.912080 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-48c8f3e1-3402-4474-b9e1-03ea322788bd tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:55.912726 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-48c8f3e1-3402-4474-b9e1-03ea322788bd tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:55.918736 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-48c8f3e1-3402-4474-b9e1-03ea322788bd tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:55.919187 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-48c8f3e1-3402-4474-b9e1-03ea322788bd tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:55.919978 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-48c8f3e1-3402-4474-b9e1-03ea322788bd tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:55.920524 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-48c8f3e1-3402-4474-b9e1-03ea322788bd tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:55.932822 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dc177581-795e-4351-b91b-7e28e27794e5 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:55.933279 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dc177581-795e-4351-b91b-7e28e27794e5 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:55.933733 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.objects.instance [None req-dc177581-795e-4351-b91b-7e28e27794e5 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lazy-loading 'fault' on Instance uuid 7c749413-8ac1-41ed-a2e4-880b92af98ca {{(pid=123567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:05:55.981308 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-dc177581-795e-4351-b91b-7e28e27794e5 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:55.989328 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-dc177581-795e-4351-b91b-7e28e27794e5 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1302 microversion: 2.1 time: 0.101004 Feb 04 18:05:55.989879 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 369/735] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:55 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1302 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:05:56.081634 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-48c8f3e1-3402-4474-b9e1-03ea322788bd tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:56.090021 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-48c8f3e1-3402-4474-b9e1-03ea322788bd tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:56.091566 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-48c8f3e1-3402-4474-b9e1-03ea322788bd tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:56.093283 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-48c8f3e1-3402-4474-b9e1-03ea322788bd tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1737 microversion: 2.20 time: 0.184412 Feb 04 18:05:56.094057 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 367/736] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:55 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:05:56.891646 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-4091d3aa-a1d7-4de8-b431-c53f8b77dd68 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:56.892258 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-4091d3aa-a1d7-4de8-b431-c53f8b77dd68 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:56.904424 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4091d3aa-a1d7-4de8-b431-c53f8b77dd68 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:56.904878 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4091d3aa-a1d7-4de8-b431-c53f8b77dd68 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:56.905670 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4091d3aa-a1d7-4de8-b431-c53f8b77dd68 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:56.906111 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4091d3aa-a1d7-4de8-b431-c53f8b77dd68 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:57.006054 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-dd964dfd-7481-490a-8171-3789132fcc0e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:57.006800 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-dd964dfd-7481-490a-8171-3789132fcc0e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:57.013201 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dd964dfd-7481-490a-8171-3789132fcc0e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:57.013739 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dd964dfd-7481-490a-8171-3789132fcc0e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:57.014696 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dd964dfd-7481-490a-8171-3789132fcc0e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:57.015233 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dd964dfd-7481-490a-8171-3789132fcc0e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:57.044928 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-4091d3aa-a1d7-4de8-b431-c53f8b77dd68 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:57.047961 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dd964dfd-7481-490a-8171-3789132fcc0e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:57.048454 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dd964dfd-7481-490a-8171-3789132fcc0e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:57.048911 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.objects.instance [None req-dd964dfd-7481-490a-8171-3789132fcc0e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lazy-loading 'fault' on Instance uuid 7c749413-8ac1-41ed-a2e4-880b92af98ca {{(pid=123566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:05:57.053244 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-4091d3aa-a1d7-4de8-b431-c53f8b77dd68 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1667 microversion: 2.1 time: 0.172074 Feb 04 18:05:57.060853 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 370/737] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:56 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1667 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:57.069716 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-37078058-7b91-40c5-a62c-ac4321e31af1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:57.070205 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-37078058-7b91-40c5-a62c-ac4321e31af1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:57.075969 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-37078058-7b91-40c5-a62c-ac4321e31af1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:57.076414 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-37078058-7b91-40c5-a62c-ac4321e31af1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:57.077278 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-37078058-7b91-40c5-a62c-ac4321e31af1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:57.077706 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-37078058-7b91-40c5-a62c-ac4321e31af1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:57.089416 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-dd964dfd-7481-490a-8171-3789132fcc0e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:57.099200 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-dd964dfd-7481-490a-8171-3789132fcc0e tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1302 microversion: 2.1 time: 0.096808 Feb 04 18:05:57.099782 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 368/738] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:57 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1302 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:57.100631 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-37078058-7b91-40c5-a62c-ac4321e31af1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c/ips" status: 200 len: 146 microversion: 2.1 time: 0.034405 Feb 04 18:05:57.106593 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 371/739] 10.222.0.98 () {58 vars in 1247 bytes} [Fri Feb 4 18:05:57 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:05:57.115703 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-6177bd5d-6639-4109-961e-e68520cbae38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:57.117596 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-6177bd5d-6639-4109-961e-e68520cbae38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:57.131001 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6177bd5d-6639-4109-961e-e68520cbae38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:57.131001 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6177bd5d-6639-4109-961e-e68520cbae38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:57.131001 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6177bd5d-6639-4109-961e-e68520cbae38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:57.131001 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6177bd5d-6639-4109-961e-e68520cbae38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:57.272407 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-6177bd5d-6639-4109-961e-e68520cbae38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:57.283607 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-6177bd5d-6639-4109-961e-e68520cbae38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:57.285289 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-6177bd5d-6639-4109-961e-e68520cbae38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:57.286508 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-6177bd5d-6639-4109-961e-e68520cbae38 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1737 microversion: 2.20 time: 0.175051 Feb 04 18:05:57.287076 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 369/740] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:57 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:05:58.116473 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a42edf0b-c22a-4409-a7b6-6fce9e21a0b0 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:58.117002 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-a42edf0b-c22a-4409-a7b6-6fce9e21a0b0 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:58.123453 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a42edf0b-c22a-4409-a7b6-6fce9e21a0b0 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:58.123932 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a42edf0b-c22a-4409-a7b6-6fce9e21a0b0 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:58.124719 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a42edf0b-c22a-4409-a7b6-6fce9e21a0b0 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:58.125156 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a42edf0b-c22a-4409-a7b6-6fce9e21a0b0 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:58.158820 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a42edf0b-c22a-4409-a7b6-6fce9e21a0b0 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:58.159271 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a42edf0b-c22a-4409-a7b6-6fce9e21a0b0 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:58.160017 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.objects.instance [None req-a42edf0b-c22a-4409-a7b6-6fce9e21a0b0 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lazy-loading 'fault' on Instance uuid 7c749413-8ac1-41ed-a2e4-880b92af98ca {{(pid=123567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:05:58.206381 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-a42edf0b-c22a-4409-a7b6-6fce9e21a0b0 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6414e43a723f47eea81f71706d1a8cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd702ff83402e4a79b37f95a3fc6775a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:58.213767 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a42edf0b-c22a-4409-a7b6-6fce9e21a0b0 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 200 len: 1302 microversion: 2.1 time: 0.101453 Feb 04 18:05:58.214338 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 372/741] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:58 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 1302 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:05:58.305268 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-23e1a0f0-c128-47b4-ae90-b9b87edd9e81 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:58.305879 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-23e1a0f0-c128-47b4-ae90-b9b87edd9e81 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:58.312541 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-23e1a0f0-c128-47b4-ae90-b9b87edd9e81 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:58.312993 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-23e1a0f0-c128-47b4-ae90-b9b87edd9e81 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:58.313775 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-23e1a0f0-c128-47b4-ae90-b9b87edd9e81 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:58.314293 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-23e1a0f0-c128-47b4-ae90-b9b87edd9e81 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:58.458931 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-23e1a0f0-c128-47b4-ae90-b9b87edd9e81 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:58.466976 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-23e1a0f0-c128-47b4-ae90-b9b87edd9e81 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:58.468514 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-23e1a0f0-c128-47b4-ae90-b9b87edd9e81 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:58.469674 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-23e1a0f0-c128-47b4-ae90-b9b87edd9e81 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1737 microversion: 2.20 time: 0.168464 Feb 04 18:05:58.470231 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 370/742] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:58 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:05:59.231111 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-52d0869d-d201-45be-ab56-e8bcf872d070 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:59.231747 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-52d0869d-d201-45be-ab56-e8bcf872d070 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] [instance: 7c749413-8ac1-41ed-a2e4-880b92af98ca] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:59.237974 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-52d0869d-d201-45be-ab56-e8bcf872d070 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:59.238462 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-52d0869d-d201-45be-ab56-e8bcf872d070 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:59.239250 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-52d0869d-d201-45be-ab56-e8bcf872d070 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:59.239719 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-52d0869d-d201-45be-ab56-e8bcf872d070 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:59.253003 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.wsgi [None req-52d0869d-d201-45be-ab56-e8bcf872d070 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] HTTP exception thrown: Instance 7c749413-8ac1-41ed-a2e4-880b92af98ca could not be found. Feb 04 18:05:59.253596 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-52d0869d-d201-45be-ab56-e8bcf872d070 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] Returning 404 to user: Instance 7c749413-8ac1-41ed-a2e4-880b92af98ca could not be found. {{(pid=123567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:05:59.254471 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-52d0869d-d201-45be-ab56-e8bcf872d070 tempest-VolumesActionsTest-1485359823 tempest-VolumesActionsTest-1485359823-project] 10.222.0.98 "GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca" status: 404 len: 111 microversion: 2.1 time: 0.027256 Feb 04 18:05:59.254994 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 373/743] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:05:59 2022] GET /compute/v2.1/servers/7c749413-8ac1-41ed-a2e4-880b92af98ca => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:05:59.487656 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-2f556caf-ccda-4876-bfe0-77e9ea7d5715 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:05:59.488352 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-2f556caf-ccda-4876-bfe0-77e9ea7d5715 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:05:59.497383 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2f556caf-ccda-4876-bfe0-77e9ea7d5715 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:59.497383 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2f556caf-ccda-4876-bfe0-77e9ea7d5715 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:59.497383 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2f556caf-ccda-4876-bfe0-77e9ea7d5715 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:05:59.497383 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2f556caf-ccda-4876-bfe0-77e9ea7d5715 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:05:59.634845 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2f556caf-ccda-4876-bfe0-77e9ea7d5715 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:59.643789 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2f556caf-ccda-4876-bfe0-77e9ea7d5715 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:59.645300 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2f556caf-ccda-4876-bfe0-77e9ea7d5715 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:05:59.646525 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-2f556caf-ccda-4876-bfe0-77e9ea7d5715 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1737 microversion: 2.20 time: 0.162457 Feb 04 18:05:59.647089 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 371/744] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:05:59 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:00.665185 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-388b8810-87ef-46cd-9390-72e789c09b68 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:00.665785 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-388b8810-87ef-46cd-9390-72e789c09b68 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:00.672025 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-388b8810-87ef-46cd-9390-72e789c09b68 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:00.672466 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-388b8810-87ef-46cd-9390-72e789c09b68 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:00.673231 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-388b8810-87ef-46cd-9390-72e789c09b68 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:00.673666 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-388b8810-87ef-46cd-9390-72e789c09b68 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:00.830476 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-388b8810-87ef-46cd-9390-72e789c09b68 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:00.840454 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-388b8810-87ef-46cd-9390-72e789c09b68 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:00.842626 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-388b8810-87ef-46cd-9390-72e789c09b68 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:00.844050 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-388b8810-87ef-46cd-9390-72e789c09b68 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1719 microversion: 2.20 time: 0.182508 Feb 04 18:06:00.846455 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 374/745] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:00 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1719 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:01.863053 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-3c85e6b2-f6e5-4fa8-979d-5ebc8ca1b3ff tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:01.863699 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-3c85e6b2-f6e5-4fa8-979d-5ebc8ca1b3ff tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:01.870353 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3c85e6b2-f6e5-4fa8-979d-5ebc8ca1b3ff tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:01.870849 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3c85e6b2-f6e5-4fa8-979d-5ebc8ca1b3ff tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:01.871635 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3c85e6b2-f6e5-4fa8-979d-5ebc8ca1b3ff tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:01.872074 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3c85e6b2-f6e5-4fa8-979d-5ebc8ca1b3ff tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:02.004149 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-3c85e6b2-f6e5-4fa8-979d-5ebc8ca1b3ff tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:02.011982 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-3c85e6b2-f6e5-4fa8-979d-5ebc8ca1b3ff tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:02.013624 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-3c85e6b2-f6e5-4fa8-979d-5ebc8ca1b3ff tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:02.014747 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-3c85e6b2-f6e5-4fa8-979d-5ebc8ca1b3ff tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1719 microversion: 2.20 time: 0.155337 Feb 04 18:06:02.015307 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 372/746] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:01 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:03.032992 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-2d71f829-9ee7-4f83-9ff0-0845332c1f97 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:03.033598 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-2d71f829-9ee7-4f83-9ff0-0845332c1f97 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:03.040240 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2d71f829-9ee7-4f83-9ff0-0845332c1f97 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:03.040695 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2d71f829-9ee7-4f83-9ff0-0845332c1f97 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:03.041474 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2d71f829-9ee7-4f83-9ff0-0845332c1f97 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:03.041915 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2d71f829-9ee7-4f83-9ff0-0845332c1f97 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:03.188023 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-2d71f829-9ee7-4f83-9ff0-0845332c1f97 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:03.195867 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-2d71f829-9ee7-4f83-9ff0-0845332c1f97 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:03.197395 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-2d71f829-9ee7-4f83-9ff0-0845332c1f97 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:03.198595 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-2d71f829-9ee7-4f83-9ff0-0845332c1f97 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1719 microversion: 2.20 time: 0.169342 Feb 04 18:06:03.199156 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 375/747] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:03 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:03.353817 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-e84db320-55b8-4a33-8dd1-9b7685b965ca req-2a5bb721-cfd9-475e-bd12-3f5ca8dbcd19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514ca883-72d2-4695-a4b6-47c18ce4add5", "name": "network-vif-unplugged", "status": "completed", "tag": "fe3cfe16-c9c7-4dcd-a6bf-b32b9ba77df0"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:06:03.355442 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:06:03.355442 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:06:03.363202 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-e84db320-55b8-4a33-8dd1-9b7685b965ca req-2a5bb721-cfd9-475e-bd12-3f5ca8dbcd19 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:03.363641 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-e84db320-55b8-4a33-8dd1-9b7685b965ca req-2a5bb721-cfd9-475e-bd12-3f5ca8dbcd19 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:03.374542 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-e84db320-55b8-4a33-8dd1-9b7685b965ca req-2a5bb721-cfd9-475e-bd12-3f5ca8dbcd19 service nova] Creating event network-vif-unplugged:fe3cfe16-c9c7-4dcd-a6bf-b32b9ba77df0 for instance 514ca883-72d2-4695-a4b6-47c18ce4add5 on hv-cinder-82276 Feb 04 18:06:03.379378 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-e84db320-55b8-4a33-8dd1-9b7685b965ca req-2a5bb721-cfd9-475e-bd12-3f5ca8dbcd19 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029157 Feb 04 18:06:03.379954 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 373/748] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:06:04.216676 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-f435c94f-27f0-4342-920a-890f1dfa60cf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:04.217370 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-f435c94f-27f0-4342-920a-890f1dfa60cf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:04.223756 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f435c94f-27f0-4342-920a-890f1dfa60cf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:04.224207 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f435c94f-27f0-4342-920a-890f1dfa60cf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:04.224991 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f435c94f-27f0-4342-920a-890f1dfa60cf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:04.225454 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f435c94f-27f0-4342-920a-890f1dfa60cf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:04.358499 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-f435c94f-27f0-4342-920a-890f1dfa60cf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:04.366586 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-f435c94f-27f0-4342-920a-890f1dfa60cf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:04.368128 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-f435c94f-27f0-4342-920a-890f1dfa60cf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:04.369276 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-f435c94f-27f0-4342-920a-890f1dfa60cf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1719 microversion: 2.20 time: 0.156329 Feb 04 18:06:04.369827 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 376/749] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:04 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:05.388925 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-c6fb786c-882b-4ac4-83bf-1cc59cb38ee8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:05.390032 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-c6fb786c-882b-4ac4-83bf-1cc59cb38ee8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:05.396289 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c6fb786c-882b-4ac4-83bf-1cc59cb38ee8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:05.396733 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c6fb786c-882b-4ac4-83bf-1cc59cb38ee8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:05.397504 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c6fb786c-882b-4ac4-83bf-1cc59cb38ee8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:05.397948 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c6fb786c-882b-4ac4-83bf-1cc59cb38ee8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:05.534229 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c6fb786c-882b-4ac4-83bf-1cc59cb38ee8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:05.542115 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c6fb786c-882b-4ac4-83bf-1cc59cb38ee8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:05.543648 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c6fb786c-882b-4ac4-83bf-1cc59cb38ee8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:05.544793 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-c6fb786c-882b-4ac4-83bf-1cc59cb38ee8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1719 microversion: 2.20 time: 0.160453 Feb 04 18:06:05.545353 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 374/750] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:05 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:06.563138 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-7947fc1d-520f-4bdf-9fbc-19182f4b6607 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:06.563905 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-7947fc1d-520f-4bdf-9fbc-19182f4b6607 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:06.570077 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7947fc1d-520f-4bdf-9fbc-19182f4b6607 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:06.570577 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7947fc1d-520f-4bdf-9fbc-19182f4b6607 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:06.571362 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7947fc1d-520f-4bdf-9fbc-19182f4b6607 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:06.571807 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7947fc1d-520f-4bdf-9fbc-19182f4b6607 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:06.729273 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-7947fc1d-520f-4bdf-9fbc-19182f4b6607 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:06.737384 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-7947fc1d-520f-4bdf-9fbc-19182f4b6607 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:06.738897 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-7947fc1d-520f-4bdf-9fbc-19182f4b6607 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:06.740038 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-7947fc1d-520f-4bdf-9fbc-19182f4b6607 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1719 microversion: 2.20 time: 0.180665 Feb 04 18:06:06.740861 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 377/751] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:06 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1719 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:06:07.758783 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-c84d6a3a-c636-418b-a0a9-ffba39038341 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:07.762015 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-c84d6a3a-c636-418b-a0a9-ffba39038341 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:07.766617 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c84d6a3a-c636-418b-a0a9-ffba39038341 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:07.767042 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c84d6a3a-c636-418b-a0a9-ffba39038341 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:07.767839 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c84d6a3a-c636-418b-a0a9-ffba39038341 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:07.768281 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c84d6a3a-c636-418b-a0a9-ffba39038341 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:07.907969 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c84d6a3a-c636-418b-a0a9-ffba39038341 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:07.916098 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c84d6a3a-c636-418b-a0a9-ffba39038341 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:07.917595 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c84d6a3a-c636-418b-a0a9-ffba39038341 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:07.918773 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-c84d6a3a-c636-418b-a0a9-ffba39038341 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1719 microversion: 2.20 time: 0.163833 Feb 04 18:06:07.919382 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 375/752] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:07 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:08.937168 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a342669a-6661-44cc-9154-f17d4760ddcf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:08.937683 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-a342669a-6661-44cc-9154-f17d4760ddcf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:08.943892 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a342669a-6661-44cc-9154-f17d4760ddcf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:08.944332 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a342669a-6661-44cc-9154-f17d4760ddcf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:08.945092 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a342669a-6661-44cc-9154-f17d4760ddcf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:08.945524 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a342669a-6661-44cc-9154-f17d4760ddcf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:09.080344 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-a342669a-6661-44cc-9154-f17d4760ddcf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:09.089069 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-a342669a-6661-44cc-9154-f17d4760ddcf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:09.090730 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-a342669a-6661-44cc-9154-f17d4760ddcf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:09.091885 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a342669a-6661-44cc-9154-f17d4760ddcf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1722 microversion: 2.20 time: 0.158539 Feb 04 18:06:09.092542 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 378/753] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:08 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:09.110041 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-65fe86e4-e1b3-4244-896b-b420ba3fb513 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18947767-c63f-4d94-a622-44b26024c4e0"}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:06:09.111124 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-65fe86e4-e1b3-4244-896b-b420ba3fb513 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:09.117765 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-65fe86e4-e1b3-4244-896b-b420ba3fb513 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:09.118220 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-65fe86e4-e1b3-4244-896b-b420ba3fb513 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:09.119046 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-65fe86e4-e1b3-4244-896b-b420ba3fb513 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:09.119489 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-65fe86e4-e1b3-4244-896b-b420ba3fb513 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:10.463183 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-65fe86e4-e1b3-4244-896b-b420ba3fb513 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "POST /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.357003 Feb 04 18:06:10.470153 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 376/754] 10.222.0.98 () {62 vars in 1363 bytes} [Fri Feb 4 18:06:09 2022] POST /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5/os-volume_attachments => generated 188 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 04 18:06:10.597491 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-0f512fe1-506c-4707-90ee-130146fac953 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:06:10.598282 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-0f512fe1-506c-4707-90ee-130146fac953 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:10.605129 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0f512fe1-506c-4707-90ee-130146fac953 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:10.607415 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0f512fe1-506c-4707-90ee-130146fac953 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:10.607415 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0f512fe1-506c-4707-90ee-130146fac953 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:10.607415 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0f512fe1-506c-4707-90ee-130146fac953 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:11.074672 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-0f512fe1-506c-4707-90ee-130146fac953 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "POST /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5/action" status: 202 len: 0 microversion: 2.20 time: 0.480966 Feb 04 18:06:11.085070 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-a205f82a-d169-4661-b65c-09b4556a13ca tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:11.085903 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-a205f82a-d169-4661-b65c-09b4556a13ca tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:11.089003 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 379/755] 10.222.0.98 () {62 vars in 1318 bytes} [Fri Feb 4 18:06:10 2022] POST /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 04 18:06:11.096982 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a205f82a-d169-4661-b65c-09b4556a13ca tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:11.097680 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a205f82a-d169-4661-b65c-09b4556a13ca tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:11.098673 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a205f82a-d169-4661-b65c-09b4556a13ca tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:11.099258 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a205f82a-d169-4661-b65c-09b4556a13ca tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:11.252039 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-a205f82a-d169-4661-b65c-09b4556a13ca tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:11.261697 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-a205f82a-d169-4661-b65c-09b4556a13ca tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:11.263923 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-a205f82a-d169-4661-b65c-09b4556a13ca tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:11.266668 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-a205f82a-d169-4661-b65c-09b4556a13ca tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1748 microversion: 2.20 time: 0.186518 Feb 04 18:06:11.267423 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 377/756] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:11 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1748 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:12.285287 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e1bdcd0a-4db6-44d7-b0c4-9c7075e43404 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:12.285835 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-e1bdcd0a-4db6-44d7-b0c4-9c7075e43404 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:12.291715 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e1bdcd0a-4db6-44d7-b0c4-9c7075e43404 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:12.292168 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e1bdcd0a-4db6-44d7-b0c4-9c7075e43404 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:12.292945 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e1bdcd0a-4db6-44d7-b0c4-9c7075e43404 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:12.293392 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e1bdcd0a-4db6-44d7-b0c4-9c7075e43404 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:12.433631 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e1bdcd0a-4db6-44d7-b0c4-9c7075e43404 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:12.442983 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e1bdcd0a-4db6-44d7-b0c4-9c7075e43404 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:12.444595 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e1bdcd0a-4db6-44d7-b0c4-9c7075e43404 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:12.445770 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e1bdcd0a-4db6-44d7-b0c4-9c7075e43404 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1748 microversion: 2.20 time: 0.164747 Feb 04 18:06:12.446517 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 380/757] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:12 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:13.464493 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-17f32240-1526-4dcd-920e-79ed83582794 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:13.465200 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-17f32240-1526-4dcd-920e-79ed83582794 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:13.471508 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-17f32240-1526-4dcd-920e-79ed83582794 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:13.471963 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-17f32240-1526-4dcd-920e-79ed83582794 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:13.472815 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-17f32240-1526-4dcd-920e-79ed83582794 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:13.473266 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-17f32240-1526-4dcd-920e-79ed83582794 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:13.608695 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-17f32240-1526-4dcd-920e-79ed83582794 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:13.617146 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-17f32240-1526-4dcd-920e-79ed83582794 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:13.618716 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-17f32240-1526-4dcd-920e-79ed83582794 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:13.619863 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-17f32240-1526-4dcd-920e-79ed83582794 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1748 microversion: 2.20 time: 0.159026 Feb 04 18:06:13.620431 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 378/758] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:13 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1748 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:14.638806 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a2f4ac30-50ad-446e-b23a-9cb0b7396383 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:14.640108 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-a2f4ac30-50ad-446e-b23a-9cb0b7396383 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:14.646227 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a2f4ac30-50ad-446e-b23a-9cb0b7396383 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:14.646706 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a2f4ac30-50ad-446e-b23a-9cb0b7396383 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:14.647477 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a2f4ac30-50ad-446e-b23a-9cb0b7396383 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:14.647911 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a2f4ac30-50ad-446e-b23a-9cb0b7396383 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:14.781399 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-a2f4ac30-50ad-446e-b23a-9cb0b7396383 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:14.789725 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-a2f4ac30-50ad-446e-b23a-9cb0b7396383 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:14.791267 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-a2f4ac30-50ad-446e-b23a-9cb0b7396383 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:14.792464 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a2f4ac30-50ad-446e-b23a-9cb0b7396383 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1750 microversion: 2.20 time: 0.157527 Feb 04 18:06:14.793030 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 381/759] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:14 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:15.811823 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-81c0b89e-832e-40c9-8266-ca8ded109150 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:15.813160 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-81c0b89e-832e-40c9-8266-ca8ded109150 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:15.820441 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-81c0b89e-832e-40c9-8266-ca8ded109150 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:15.821191 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-81c0b89e-832e-40c9-8266-ca8ded109150 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:15.822389 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-81c0b89e-832e-40c9-8266-ca8ded109150 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:15.823072 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-81c0b89e-832e-40c9-8266-ca8ded109150 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:15.987114 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-81c0b89e-832e-40c9-8266-ca8ded109150 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:15.998617 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-81c0b89e-832e-40c9-8266-ca8ded109150 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:16.001212 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-81c0b89e-832e-40c9-8266-ca8ded109150 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:16.002653 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-81c0b89e-832e-40c9-8266-ca8ded109150 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1750 microversion: 2.20 time: 0.195333 Feb 04 18:06:16.013822 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 379/760] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:15 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1750 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:17.021331 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-19e151bc-8fb5-4678-a5a8-884c858a79c4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:17.021938 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-19e151bc-8fb5-4678-a5a8-884c858a79c4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:17.029382 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-19e151bc-8fb5-4678-a5a8-884c858a79c4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:17.030951 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-19e151bc-8fb5-4678-a5a8-884c858a79c4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:17.031797 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-19e151bc-8fb5-4678-a5a8-884c858a79c4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:17.032232 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-19e151bc-8fb5-4678-a5a8-884c858a79c4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:17.287966 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-19e151bc-8fb5-4678-a5a8-884c858a79c4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:17.298103 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-19e151bc-8fb5-4678-a5a8-884c858a79c4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:17.300751 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-19e151bc-8fb5-4678-a5a8-884c858a79c4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:17.300751 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-19e151bc-8fb5-4678-a5a8-884c858a79c4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1750 microversion: 2.20 time: 0.283492 Feb 04 18:06:17.301477 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 382/761] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:17 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1750 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:17.678479 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-c0f2df9e-f94f-41a7-92eb-ad4ad6734a9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-186777260", "imageRef": "b0fb57f5-967d-4692-94f3-accee37910c3", "flavorRef": "452", "networks": [{"uuid": "0455843b-79c5-48f6-8274-5cd710fb9067"}]}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:06:17.746381 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.network.neutron [None req-c0f2df9e-f94f-41a7-92eb-ad4ad6734a9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] validate_networks() for [('0455843b-79c5-48f6-8274-5cd710fb9067', None, None, None, None, None)] {{(pid=123566) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 04 18:06:18.172065 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-c0f2df9e-f94f-41a7-92eb-ad4ad6734a9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Flavor limits 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 04 18:06:18.172742 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-c0f2df9e-f94f-41a7-92eb-ad4ad6734a9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Image limits 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 04 18:06:18.174017 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-c0f2df9e-f94f-41a7-92eb-ad4ad6734a9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Flavor pref 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 04 18:06:18.174842 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-c0f2df9e-f94f-41a7-92eb-ad4ad6734a9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Image pref 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 04 18:06:18.180310 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-c0f2df9e-f94f-41a7-92eb-ad4ad6734a9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 04 18:06:18.185682 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c0f2df9e-f94f-41a7-92eb-ad4ad6734a9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:18.186478 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c0f2df9e-f94f-41a7-92eb-ad4ad6734a9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:18.187665 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c0f2df9e-f94f-41a7-92eb-ad4ad6734a9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:18.188290 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c0f2df9e-f94f-41a7-92eb-ad4ad6734a9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:18.205747 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-c0f2df9e-f94f-41a7-92eb-ad4ad6734a9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Getting quotas for project c5a4531047cd4d73a0ccd2807d2a282e. Resources: {'cores', 'ram', 'instances'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:06:18.212081 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-c0f2df9e-f94f-41a7-92eb-ad4ad6734a9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Getting quotas for user 6ca8827f98ae4e1085ac670f76898113 and project c5a4531047cd4d73a0ccd2807d2a282e. Resources: {'cores', 'ram', 'instances'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:06:18.226814 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-c0f2df9e-f94f-41a7-92eb-ad4ad6734a9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Going to run 1 instances... {{(pid=123566) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 04 18:06:18.234587 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-c0f2df9e-f94f-41a7-92eb-ad4ad6734a9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0fb57f5-967d-4692-94f3-accee37910c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 04 18:06:18.326201 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b5969adb-fd57-4965-8354-9b42fb1990be tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:18.326201 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-b5969adb-fd57-4965-8354-9b42fb1990be tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:18.337929 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b5969adb-fd57-4965-8354-9b42fb1990be tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:18.340201 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b5969adb-fd57-4965-8354-9b42fb1990be tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:18.341009 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b5969adb-fd57-4965-8354-9b42fb1990be tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:18.341463 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b5969adb-fd57-4965-8354-9b42fb1990be tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:18.460647 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-c0f2df9e-f94f-41a7-92eb-ad4ad6734a9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.786320 Feb 04 18:06:18.462093 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 380/762] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Feb 4 18:06:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 04 18:06:18.479256 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-e9c82d66-10f5-41f1-bef9-af0c53ecdae0 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:18.480240 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-e9c82d66-10f5-41f1-bef9-af0c53ecdae0 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:18.563374 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-e9c82d66-10f5-41f1-bef9-af0c53ecdae0 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:18.573450 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-e9c82d66-10f5-41f1-bef9-af0c53ecdae0 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1218 microversion: 2.1 time: 0.105194 Feb 04 18:06:18.578328 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 381/763] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:18 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:06:18.605775 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-b5969adb-fd57-4965-8354-9b42fb1990be tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:18.620960 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-b5969adb-fd57-4965-8354-9b42fb1990be tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:18.627404 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-b5969adb-fd57-4965-8354-9b42fb1990be tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:18.629825 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b5969adb-fd57-4965-8354-9b42fb1990be tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1750 microversion: 2.20 time: 0.312302 Feb 04 18:06:18.631002 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 383/764] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:18 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1750 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:19.593183 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-70f615cf-25cf-4544-93d3-95819a7a202a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:19.593921 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-70f615cf-25cf-4544-93d3-95819a7a202a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:19.605488 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-70f615cf-25cf-4544-93d3-95819a7a202a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:19.605950 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-70f615cf-25cf-4544-93d3-95819a7a202a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:19.606896 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-70f615cf-25cf-4544-93d3-95819a7a202a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:19.607245 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-70f615cf-25cf-4544-93d3-95819a7a202a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:19.650523 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-5e2dfa02-60c4-4d0e-8e7c-5c7f7e510cf8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:19.651496 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-5e2dfa02-60c4-4d0e-8e7c-5c7f7e510cf8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:19.660737 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5e2dfa02-60c4-4d0e-8e7c-5c7f7e510cf8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:19.661500 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5e2dfa02-60c4-4d0e-8e7c-5c7f7e510cf8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:19.664399 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5e2dfa02-60c4-4d0e-8e7c-5c7f7e510cf8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:19.665015 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5e2dfa02-60c4-4d0e-8e7c-5c7f7e510cf8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:19.738725 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-70f615cf-25cf-4544-93d3-95819a7a202a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:19.748186 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-70f615cf-25cf-4544-93d3-95819a7a202a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1222 microversion: 2.1 time: 0.158442 Feb 04 18:06:19.753861 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 382/765] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:19 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1222 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:06:19.920519 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5e2dfa02-60c4-4d0e-8e7c-5c7f7e510cf8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:19.929897 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5e2dfa02-60c4-4d0e-8e7c-5c7f7e510cf8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:19.934407 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5e2dfa02-60c4-4d0e-8e7c-5c7f7e510cf8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:19.935862 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-5e2dfa02-60c4-4d0e-8e7c-5c7f7e510cf8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.290298 Feb 04 18:06:19.937561 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 384/766] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:19 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:06:20.764473 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-30d0ce99-ceb0-4338-b02e-c177638254a2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:20.765067 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-30d0ce99-ceb0-4338-b02e-c177638254a2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:20.771236 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-30d0ce99-ceb0-4338-b02e-c177638254a2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:20.771684 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-30d0ce99-ceb0-4338-b02e-c177638254a2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:20.772446 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-30d0ce99-ceb0-4338-b02e-c177638254a2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:20.772876 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-30d0ce99-ceb0-4338-b02e-c177638254a2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:20.832905 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-30d0ce99-ceb0-4338-b02e-c177638254a2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:20.840268 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-30d0ce99-ceb0-4338-b02e-c177638254a2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1270 microversion: 2.1 time: 0.079416 Feb 04 18:06:20.840846 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 383/767] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:20 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1270 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:06:20.955058 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3e2a0d51-4f78-4d4a-98df-20d6498cff5c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:20.956334 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-3e2a0d51-4f78-4d4a-98df-20d6498cff5c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:20.962965 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3e2a0d51-4f78-4d4a-98df-20d6498cff5c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:20.963416 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3e2a0d51-4f78-4d4a-98df-20d6498cff5c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:20.964190 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3e2a0d51-4f78-4d4a-98df-20d6498cff5c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:20.964619 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3e2a0d51-4f78-4d4a-98df-20d6498cff5c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:21.101291 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-3e2a0d51-4f78-4d4a-98df-20d6498cff5c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:21.111016 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-3e2a0d51-4f78-4d4a-98df-20d6498cff5c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:21.112498 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-3e2a0d51-4f78-4d4a-98df-20d6498cff5c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:21.113726 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-3e2a0d51-4f78-4d4a-98df-20d6498cff5c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.162909 Feb 04 18:06:21.114182 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 385/768] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:20 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:21.867386 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-df186d3e-b060-45b0-87c7-3b3976d9344e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:21.868302 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-df186d3e-b060-45b0-87c7-3b3976d9344e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:21.878683 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-df186d3e-b060-45b0-87c7-3b3976d9344e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:21.879612 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-df186d3e-b060-45b0-87c7-3b3976d9344e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:21.880701 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-df186d3e-b060-45b0-87c7-3b3976d9344e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:21.881536 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-df186d3e-b060-45b0-87c7-3b3976d9344e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:22.009250 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-df186d3e-b060-45b0-87c7-3b3976d9344e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:22.025561 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-df186d3e-b060-45b0-87c7-3b3976d9344e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1278 microversion: 2.1 time: 0.163489 Feb 04 18:06:22.026158 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 384/769] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:21 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:06:22.133507 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-cbf51d68-6958-4b5d-985f-2232a9a9b4ab tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:22.134964 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-cbf51d68-6958-4b5d-985f-2232a9a9b4ab tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:22.150570 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cbf51d68-6958-4b5d-985f-2232a9a9b4ab tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:22.154652 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cbf51d68-6958-4b5d-985f-2232a9a9b4ab tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:22.156258 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cbf51d68-6958-4b5d-985f-2232a9a9b4ab tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:22.156850 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cbf51d68-6958-4b5d-985f-2232a9a9b4ab tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:22.396239 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-cbf51d68-6958-4b5d-985f-2232a9a9b4ab tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:22.402616 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-cbf51d68-6958-4b5d-985f-2232a9a9b4ab tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:22.404526 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-cbf51d68-6958-4b5d-985f-2232a9a9b4ab tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:22.406074 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-cbf51d68-6958-4b5d-985f-2232a9a9b4ab tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.277335 Feb 04 18:06:22.418110 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 386/770] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:22 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:06:23.048508 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-f8ea654a-b614-4d35-8397-1780da10991e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:23.052277 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-f8ea654a-b614-4d35-8397-1780da10991e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:23.061177 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f8ea654a-b614-4d35-8397-1780da10991e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:23.061809 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f8ea654a-b614-4d35-8397-1780da10991e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:23.062783 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f8ea654a-b614-4d35-8397-1780da10991e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:23.063359 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f8ea654a-b614-4d35-8397-1780da10991e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:23.160807 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-f8ea654a-b614-4d35-8397-1780da10991e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:23.170738 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-f8ea654a-b614-4d35-8397-1780da10991e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1278 microversion: 2.1 time: 0.131355 Feb 04 18:06:23.171925 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 385/771] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:23 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1278 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:06:23.424469 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-8591ca6b-37b3-41bf-ad64-4ace449c9fc9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:23.426095 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-8591ca6b-37b3-41bf-ad64-4ace449c9fc9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:23.432632 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8591ca6b-37b3-41bf-ad64-4ace449c9fc9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:23.433045 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8591ca6b-37b3-41bf-ad64-4ace449c9fc9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:23.433832 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8591ca6b-37b3-41bf-ad64-4ace449c9fc9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:23.434278 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8591ca6b-37b3-41bf-ad64-4ace449c9fc9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:23.646663 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-8591ca6b-37b3-41bf-ad64-4ace449c9fc9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:23.662104 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-8591ca6b-37b3-41bf-ad64-4ace449c9fc9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:23.664172 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-8591ca6b-37b3-41bf-ad64-4ace449c9fc9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:23.665522 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-8591ca6b-37b3-41bf-ad64-4ace449c9fc9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.244967 Feb 04 18:06:23.677750 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 387/772] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:23 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:24.190124 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-97def337-81cb-496b-8610-b52447dcbd1a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:24.200901 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-97def337-81cb-496b-8610-b52447dcbd1a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:24.200901 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-97def337-81cb-496b-8610-b52447dcbd1a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:24.200901 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-97def337-81cb-496b-8610-b52447dcbd1a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:24.202982 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-97def337-81cb-496b-8610-b52447dcbd1a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:24.212734 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-97def337-81cb-496b-8610-b52447dcbd1a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:24.282072 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-97def337-81cb-496b-8610-b52447dcbd1a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:24.290287 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-97def337-81cb-496b-8610-b52447dcbd1a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1278 microversion: 2.1 time: 0.104596 Feb 04 18:06:24.290901 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 386/773] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:24 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1278 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:06:24.688982 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-1b5974a0-3d33-4e67-93f1-b27df314194c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:24.690872 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-1b5974a0-3d33-4e67-93f1-b27df314194c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:24.713057 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1b5974a0-3d33-4e67-93f1-b27df314194c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:24.715397 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1b5974a0-3d33-4e67-93f1-b27df314194c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:24.720770 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1b5974a0-3d33-4e67-93f1-b27df314194c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:24.723046 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1b5974a0-3d33-4e67-93f1-b27df314194c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:24.976139 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-1b5974a0-3d33-4e67-93f1-b27df314194c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:24.999690 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-1b5974a0-3d33-4e67-93f1-b27df314194c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:25.002944 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-1b5974a0-3d33-4e67-93f1-b27df314194c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:25.007183 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-1b5974a0-3d33-4e67-93f1-b27df314194c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.324046 Feb 04 18:06:25.024731 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 388/774] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:24 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:25.312855 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-0bb96d06-7f28-42fa-872c-581c3ee8bf1d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:25.314341 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-0bb96d06-7f28-42fa-872c-581c3ee8bf1d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:25.323409 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0bb96d06-7f28-42fa-872c-581c3ee8bf1d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:25.324359 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0bb96d06-7f28-42fa-872c-581c3ee8bf1d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:25.325501 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0bb96d06-7f28-42fa-872c-581c3ee8bf1d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:25.326099 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0bb96d06-7f28-42fa-872c-581c3ee8bf1d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:25.412584 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-0bb96d06-7f28-42fa-872c-581c3ee8bf1d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:25.420866 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-0bb96d06-7f28-42fa-872c-581c3ee8bf1d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1278 microversion: 2.1 time: 0.116857 Feb 04 18:06:25.430691 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 387/775] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:25 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1278 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:06:26.029308 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-df89d1a8-b460-4289-b58a-1930bac6a6e0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:26.030527 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-df89d1a8-b460-4289-b58a-1930bac6a6e0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:26.043784 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-df89d1a8-b460-4289-b58a-1930bac6a6e0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:26.044252 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-df89d1a8-b460-4289-b58a-1930bac6a6e0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:26.045062 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-df89d1a8-b460-4289-b58a-1930bac6a6e0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:26.046764 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-df89d1a8-b460-4289-b58a-1930bac6a6e0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:26.367701 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-df89d1a8-b460-4289-b58a-1930bac6a6e0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:26.377324 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-df89d1a8-b460-4289-b58a-1930bac6a6e0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:26.394996 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-df89d1a8-b460-4289-b58a-1930bac6a6e0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:26.397037 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-df89d1a8-b460-4289-b58a-1930bac6a6e0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.371389 Feb 04 18:06:26.398573 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 389/776] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:26 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:26.453545 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-5b5548e2-3453-4254-bbb5-f4f27cffce9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:26.456829 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-5b5548e2-3453-4254-bbb5-f4f27cffce9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:26.476749 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5b5548e2-3453-4254-bbb5-f4f27cffce9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:26.477480 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5b5548e2-3453-4254-bbb5-f4f27cffce9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:26.478553 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5b5548e2-3453-4254-bbb5-f4f27cffce9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:26.479140 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5b5548e2-3453-4254-bbb5-f4f27cffce9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:26.558080 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-5b5548e2-3453-4254-bbb5-f4f27cffce9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:26.567833 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-5b5548e2-3453-4254-bbb5-f4f27cffce9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1278 microversion: 2.1 time: 0.131635 Feb 04 18:06:26.568412 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 388/777] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:26 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1278 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:06:27.432267 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-74c9bb00-0be0-4460-8f26-29652a888fc0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:27.433600 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-74c9bb00-0be0-4460-8f26-29652a888fc0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:27.454609 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-74c9bb00-0be0-4460-8f26-29652a888fc0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:27.455290 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-74c9bb00-0be0-4460-8f26-29652a888fc0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:27.456092 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-74c9bb00-0be0-4460-8f26-29652a888fc0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:27.456535 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-74c9bb00-0be0-4460-8f26-29652a888fc0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:27.592893 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-de474d0b-8a4f-4ac7-90b2-f50bc8478b4a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:27.595400 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-de474d0b-8a4f-4ac7-90b2-f50bc8478b4a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:27.611228 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-de474d0b-8a4f-4ac7-90b2-f50bc8478b4a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:27.618347 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-de474d0b-8a4f-4ac7-90b2-f50bc8478b4a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:27.619500 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-de474d0b-8a4f-4ac7-90b2-f50bc8478b4a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:27.620097 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-de474d0b-8a4f-4ac7-90b2-f50bc8478b4a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:27.692071 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-74c9bb00-0be0-4460-8f26-29652a888fc0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:27.704399 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-74c9bb00-0be0-4460-8f26-29652a888fc0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:27.708120 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-74c9bb00-0be0-4460-8f26-29652a888fc0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:27.708120 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-74c9bb00-0be0-4460-8f26-29652a888fc0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.279062 Feb 04 18:06:27.719119 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 390/778] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:27 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:27.740567 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-de474d0b-8a4f-4ac7-90b2-f50bc8478b4a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:27.749351 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-de474d0b-8a4f-4ac7-90b2-f50bc8478b4a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1278 microversion: 2.1 time: 0.164268 Feb 04 18:06:27.750515 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 389/779] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:27 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:06:28.727535 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-2e56d69b-650e-4645-b2e2-32f1eb29f2dc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:28.733119 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-2e56d69b-650e-4645-b2e2-32f1eb29f2dc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:28.736464 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2e56d69b-650e-4645-b2e2-32f1eb29f2dc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:28.737188 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2e56d69b-650e-4645-b2e2-32f1eb29f2dc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:28.738236 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2e56d69b-650e-4645-b2e2-32f1eb29f2dc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:28.738950 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2e56d69b-650e-4645-b2e2-32f1eb29f2dc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:28.766454 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-bb551965-1185-44dd-a280-0b1fe8979a65 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:28.767083 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-bb551965-1185-44dd-a280-0b1fe8979a65 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:28.786141 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bb551965-1185-44dd-a280-0b1fe8979a65 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:28.786635 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bb551965-1185-44dd-a280-0b1fe8979a65 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:28.787432 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bb551965-1185-44dd-a280-0b1fe8979a65 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:28.787876 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bb551965-1185-44dd-a280-0b1fe8979a65 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:29.221467 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-bb551965-1185-44dd-a280-0b1fe8979a65 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:29.241482 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-bb551965-1185-44dd-a280-0b1fe8979a65 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1278 microversion: 2.1 time: 0.479123 Feb 04 18:06:29.245090 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 390/780] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:28 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1278 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:06:29.295628 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-2e56d69b-650e-4645-b2e2-32f1eb29f2dc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:29.305368 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-2e56d69b-650e-4645-b2e2-32f1eb29f2dc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:29.312866 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-2e56d69b-650e-4645-b2e2-32f1eb29f2dc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:29.314386 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-2e56d69b-650e-4645-b2e2-32f1eb29f2dc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.590569 Feb 04 18:06:29.315617 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 391/781] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:28 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:06:30.265788 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-7a65fe76-8e37-44fe-9058-35b39780f221 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:30.267453 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-7a65fe76-8e37-44fe-9058-35b39780f221 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:30.275617 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7a65fe76-8e37-44fe-9058-35b39780f221 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:30.276406 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7a65fe76-8e37-44fe-9058-35b39780f221 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:30.277658 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7a65fe76-8e37-44fe-9058-35b39780f221 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:30.278350 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7a65fe76-8e37-44fe-9058-35b39780f221 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:30.335032 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-5e96fc51-7589-4a0e-bb2b-70726c6e6e20 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:30.336469 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-5e96fc51-7589-4a0e-bb2b-70726c6e6e20 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:30.350332 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5e96fc51-7589-4a0e-bb2b-70726c6e6e20 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:30.353622 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5e96fc51-7589-4a0e-bb2b-70726c6e6e20 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:30.357515 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5e96fc51-7589-4a0e-bb2b-70726c6e6e20 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:30.360768 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5e96fc51-7589-4a0e-bb2b-70726c6e6e20 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:30.397024 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-7a65fe76-8e37-44fe-9058-35b39780f221 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:30.406808 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-7a65fe76-8e37-44fe-9058-35b39780f221 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1278 microversion: 2.1 time: 0.148542 Feb 04 18:06:30.409441 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 391/782] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:30 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:06:30.637426 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5e96fc51-7589-4a0e-bb2b-70726c6e6e20 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:30.657996 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5e96fc51-7589-4a0e-bb2b-70726c6e6e20 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:30.659755 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5e96fc51-7589-4a0e-bb2b-70726c6e6e20 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:30.661235 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-5e96fc51-7589-4a0e-bb2b-70726c6e6e20 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.331057 Feb 04 18:06:30.671635 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 392/783] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:30 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:31.425121 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-9bc0a7d9-f39e-4527-ad7e-0652a2bb2103 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:31.426648 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-9bc0a7d9-f39e-4527-ad7e-0652a2bb2103 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:31.434636 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9bc0a7d9-f39e-4527-ad7e-0652a2bb2103 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:31.435481 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9bc0a7d9-f39e-4527-ad7e-0652a2bb2103 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:31.437249 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9bc0a7d9-f39e-4527-ad7e-0652a2bb2103 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:31.438199 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9bc0a7d9-f39e-4527-ad7e-0652a2bb2103 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:31.527215 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-9bc0a7d9-f39e-4527-ad7e-0652a2bb2103 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:31.536745 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-9bc0a7d9-f39e-4527-ad7e-0652a2bb2103 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1278 microversion: 2.1 time: 0.115180 Feb 04 18:06:31.548936 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 392/784] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:31 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1278 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:06:31.679414 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-ceeac534-aa5c-4fed-a32e-eff61ae21197 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:31.680024 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-ceeac534-aa5c-4fed-a32e-eff61ae21197 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:31.699238 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ceeac534-aa5c-4fed-a32e-eff61ae21197 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:31.699695 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ceeac534-aa5c-4fed-a32e-eff61ae21197 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:31.700518 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ceeac534-aa5c-4fed-a32e-eff61ae21197 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:31.700972 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ceeac534-aa5c-4fed-a32e-eff61ae21197 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:31.937272 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ceeac534-aa5c-4fed-a32e-eff61ae21197 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:31.945785 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ceeac534-aa5c-4fed-a32e-eff61ae21197 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:31.947477 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ceeac534-aa5c-4fed-a32e-eff61ae21197 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:31.948748 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-ceeac534-aa5c-4fed-a32e-eff61ae21197 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.273253 Feb 04 18:06:31.949348 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 393/785] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:31 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:32.555225 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-04ca47da-6922-4c4b-9202-3a71720b1b7d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:32.555919 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-04ca47da-6922-4c4b-9202-3a71720b1b7d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:32.573524 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-04ca47da-6922-4c4b-9202-3a71720b1b7d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:32.580506 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-04ca47da-6922-4c4b-9202-3a71720b1b7d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:32.588245 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-04ca47da-6922-4c4b-9202-3a71720b1b7d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:32.588757 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-04ca47da-6922-4c4b-9202-3a71720b1b7d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:32.731469 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-04ca47da-6922-4c4b-9202-3a71720b1b7d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:32.741572 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-04ca47da-6922-4c4b-9202-3a71720b1b7d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1278 microversion: 2.1 time: 0.188499 Feb 04 18:06:32.752543 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 393/786] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:32 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1278 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:06:32.966591 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3492f013-5a9c-4967-afc8-3a9e6eb7cbfc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:32.967250 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-3492f013-5a9c-4967-afc8-3a9e6eb7cbfc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:32.974339 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3492f013-5a9c-4967-afc8-3a9e6eb7cbfc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:32.974891 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3492f013-5a9c-4967-afc8-3a9e6eb7cbfc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:32.975648 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3492f013-5a9c-4967-afc8-3a9e6eb7cbfc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:32.976094 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3492f013-5a9c-4967-afc8-3a9e6eb7cbfc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:33.114018 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-3492f013-5a9c-4967-afc8-3a9e6eb7cbfc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:33.122855 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-3492f013-5a9c-4967-afc8-3a9e6eb7cbfc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:33.131430 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-3492f013-5a9c-4967-afc8-3a9e6eb7cbfc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:33.131430 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-3492f013-5a9c-4967-afc8-3a9e6eb7cbfc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.162976 Feb 04 18:06:33.131430 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 394/787] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:32 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:33.759059 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-9362d27e-c5a9-4f57-a5bc-d808cc308fe3 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:33.759762 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-9362d27e-c5a9-4f57-a5bc-d808cc308fe3 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:33.768281 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9362d27e-c5a9-4f57-a5bc-d808cc308fe3 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:33.768737 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9362d27e-c5a9-4f57-a5bc-d808cc308fe3 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:33.769561 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9362d27e-c5a9-4f57-a5bc-d808cc308fe3 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:33.770001 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9362d27e-c5a9-4f57-a5bc-d808cc308fe3 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:33.839899 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-9362d27e-c5a9-4f57-a5bc-d808cc308fe3 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:33.843673 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-9362d27e-c5a9-4f57-a5bc-d808cc308fe3 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1278 microversion: 2.1 time: 0.088300 Feb 04 18:06:33.844253 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 394/788] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:33 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1278 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:06:34.145193 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-37e200ec-016b-4b56-94ac-0c3e28682ef1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:34.145762 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-37e200ec-016b-4b56-94ac-0c3e28682ef1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:34.152200 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-37e200ec-016b-4b56-94ac-0c3e28682ef1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:34.153455 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-37e200ec-016b-4b56-94ac-0c3e28682ef1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:34.153589 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-37e200ec-016b-4b56-94ac-0c3e28682ef1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:34.154020 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-37e200ec-016b-4b56-94ac-0c3e28682ef1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:34.291976 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-37e200ec-016b-4b56-94ac-0c3e28682ef1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:34.300288 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-37e200ec-016b-4b56-94ac-0c3e28682ef1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:34.302537 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-37e200ec-016b-4b56-94ac-0c3e28682ef1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:34.302999 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-37e200ec-016b-4b56-94ac-0c3e28682ef1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.161709 Feb 04 18:06:34.303551 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 395/789] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:34 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:34.867258 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-49899b03-9f61-44ca-bcbd-900dae057fb8 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:34.867258 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-49899b03-9f61-44ca-bcbd-900dae057fb8 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:34.871056 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-49899b03-9f61-44ca-bcbd-900dae057fb8 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:34.871572 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-49899b03-9f61-44ca-bcbd-900dae057fb8 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:34.872397 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-49899b03-9f61-44ca-bcbd-900dae057fb8 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:34.872836 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-49899b03-9f61-44ca-bcbd-900dae057fb8 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:34.945999 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-49899b03-9f61-44ca-bcbd-900dae057fb8 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:34.953570 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-49899b03-9f61-44ca-bcbd-900dae057fb8 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1278 microversion: 2.1 time: 0.094335 Feb 04 18:06:34.954164 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 395/790] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:34 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1278 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:06:35.320861 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-5ed0f179-e581-493e-b2ce-f3b06a694623 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:35.321487 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-5ed0f179-e581-493e-b2ce-f3b06a694623 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:35.328120 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5ed0f179-e581-493e-b2ce-f3b06a694623 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:35.328569 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5ed0f179-e581-493e-b2ce-f3b06a694623 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:35.331395 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5ed0f179-e581-493e-b2ce-f3b06a694623 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:35.331395 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5ed0f179-e581-493e-b2ce-f3b06a694623 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:35.463075 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5ed0f179-e581-493e-b2ce-f3b06a694623 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:35.471260 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5ed0f179-e581-493e-b2ce-f3b06a694623 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:35.472721 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5ed0f179-e581-493e-b2ce-f3b06a694623 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:35.473862 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-5ed0f179-e581-493e-b2ce-f3b06a694623 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.156690 Feb 04 18:06:35.474423 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 396/791] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:35 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:35.970317 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-66b397af-c134-4b94-82c1-17362a60d907 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:35.971062 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-66b397af-c134-4b94-82c1-17362a60d907 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:35.977626 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-66b397af-c134-4b94-82c1-17362a60d907 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:35.978076 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-66b397af-c134-4b94-82c1-17362a60d907 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:35.978896 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-66b397af-c134-4b94-82c1-17362a60d907 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:35.979334 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-66b397af-c134-4b94-82c1-17362a60d907 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:36.039935 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-66b397af-c134-4b94-82c1-17362a60d907 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:36.047746 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-66b397af-c134-4b94-82c1-17362a60d907 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1278 microversion: 2.1 time: 0.081564 Feb 04 18:06:36.048259 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 396/792] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:35 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1278 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:06:36.492892 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c94a5ab6-52f3-43d0-8c60-531c5f6cfc51 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:36.493656 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c94a5ab6-52f3-43d0-8c60-531c5f6cfc51 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:36.500452 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c94a5ab6-52f3-43d0-8c60-531c5f6cfc51 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:36.500859 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c94a5ab6-52f3-43d0-8c60-531c5f6cfc51 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:36.501654 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c94a5ab6-52f3-43d0-8c60-531c5f6cfc51 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:36.502099 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c94a5ab6-52f3-43d0-8c60-531c5f6cfc51 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:36.637977 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c94a5ab6-52f3-43d0-8c60-531c5f6cfc51 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:36.646922 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c94a5ab6-52f3-43d0-8c60-531c5f6cfc51 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:36.648565 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c94a5ab6-52f3-43d0-8c60-531c5f6cfc51 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:36.655868 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c94a5ab6-52f3-43d0-8c60-531c5f6cfc51 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.161087 Feb 04 18:06:36.655868 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 397/793] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:36 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:06:37.068003 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-cd80ac84-6258-4436-bd31-9e224f226453 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:37.068541 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-cd80ac84-6258-4436-bd31-9e224f226453 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:37.075664 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cd80ac84-6258-4436-bd31-9e224f226453 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:37.076365 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cd80ac84-6258-4436-bd31-9e224f226453 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:37.077326 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cd80ac84-6258-4436-bd31-9e224f226453 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:37.077944 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cd80ac84-6258-4436-bd31-9e224f226453 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:37.158684 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-cd80ac84-6258-4436-bd31-9e224f226453 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:37.167402 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-cd80ac84-6258-4436-bd31-9e224f226453 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1278 microversion: 2.1 time: 0.103973 Feb 04 18:06:37.168158 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 397/794] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:37 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1278 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:06:37.667381 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-76c3c839-d98d-40c6-a17e-f47acb78ba09 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:37.667943 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-76c3c839-d98d-40c6-a17e-f47acb78ba09 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:37.674724 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-76c3c839-d98d-40c6-a17e-f47acb78ba09 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:37.675175 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-76c3c839-d98d-40c6-a17e-f47acb78ba09 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:37.676022 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-76c3c839-d98d-40c6-a17e-f47acb78ba09 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:37.676541 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-76c3c839-d98d-40c6-a17e-f47acb78ba09 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:37.809479 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-76c3c839-d98d-40c6-a17e-f47acb78ba09 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:37.817645 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-76c3c839-d98d-40c6-a17e-f47acb78ba09 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:37.819229 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-76c3c839-d98d-40c6-a17e-f47acb78ba09 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:37.820381 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-76c3c839-d98d-40c6-a17e-f47acb78ba09 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.157371 Feb 04 18:06:37.820940 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 398/795] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:37 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:38.184635 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-6154ad52-a2cd-44e3-9eff-6f602935ce97 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:38.185216 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-6154ad52-a2cd-44e3-9eff-6f602935ce97 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:38.194968 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6154ad52-a2cd-44e3-9eff-6f602935ce97 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:38.194968 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6154ad52-a2cd-44e3-9eff-6f602935ce97 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:38.194968 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6154ad52-a2cd-44e3-9eff-6f602935ce97 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:38.194968 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6154ad52-a2cd-44e3-9eff-6f602935ce97 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:38.258933 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-6154ad52-a2cd-44e3-9eff-6f602935ce97 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:38.266153 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-6154ad52-a2cd-44e3-9eff-6f602935ce97 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1278 microversion: 2.1 time: 0.085302 Feb 04 18:06:38.266774 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 398/796] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:38 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1278 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:06:38.842536 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-ff1898a7-0cd1-4e8b-b01d-3b2207f3545b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:38.843803 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-ff1898a7-0cd1-4e8b-b01d-3b2207f3545b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:38.852807 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ff1898a7-0cd1-4e8b-b01d-3b2207f3545b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:38.853314 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ff1898a7-0cd1-4e8b-b01d-3b2207f3545b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:38.854711 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ff1898a7-0cd1-4e8b-b01d-3b2207f3545b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:38.855324 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ff1898a7-0cd1-4e8b-b01d-3b2207f3545b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:38.997604 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ff1898a7-0cd1-4e8b-b01d-3b2207f3545b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:39.006642 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ff1898a7-0cd1-4e8b-b01d-3b2207f3545b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:39.008137 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ff1898a7-0cd1-4e8b-b01d-3b2207f3545b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:39.009345 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-ff1898a7-0cd1-4e8b-b01d-3b2207f3545b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.171014 Feb 04 18:06:39.009905 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 399/797] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:38 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:39.282873 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-618424f6-99d7-4e05-927c-efc9c18c1ce4 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:39.283483 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-618424f6-99d7-4e05-927c-efc9c18c1ce4 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:39.290358 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-618424f6-99d7-4e05-927c-efc9c18c1ce4 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:39.291037 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-618424f6-99d7-4e05-927c-efc9c18c1ce4 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:39.291965 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-618424f6-99d7-4e05-927c-efc9c18c1ce4 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:39.292408 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-618424f6-99d7-4e05-927c-efc9c18c1ce4 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:39.424749 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-618424f6-99d7-4e05-927c-efc9c18c1ce4 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:39.432130 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-618424f6-99d7-4e05-927c-efc9c18c1ce4 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1318 microversion: 2.1 time: 0.153046 Feb 04 18:06:39.432698 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 399/798] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:39 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:06:39.977619 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-6d31a4fc-3d6f-4f8b-8855-dccb88cd2d56 req-e36f5605-83f5-4e64-99a8-dacac7b218c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd", "tag": "a40a8554-e208-44a5-a81c-393bb0866fff"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:06:39.979337 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:06:39.979337 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:06:39.986026 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-6d31a4fc-3d6f-4f8b-8855-dccb88cd2d56 req-e36f5605-83f5-4e64-99a8-dacac7b218c3 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:39.986510 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-6d31a4fc-3d6f-4f8b-8855-dccb88cd2d56 req-e36f5605-83f5-4e64-99a8-dacac7b218c3 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:39.997801 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-6d31a4fc-3d6f-4f8b-8855-dccb88cd2d56 req-e36f5605-83f5-4e64-99a8-dacac7b218c3 service nova] Creating event network-changed:a40a8554-e208-44a5-a81c-393bb0866fff for instance 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd on hv-cinder-82276 Feb 04 18:06:40.003091 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-6d31a4fc-3d6f-4f8b-8855-dccb88cd2d56 req-e36f5605-83f5-4e64-99a8-dacac7b218c3 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202267 Feb 04 18:06:40.003679 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 400/799] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:06:40.027272 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-64f6e33a-b936-4060-9366-1ccb6d44a16e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:40.027879 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-64f6e33a-b936-4060-9366-1ccb6d44a16e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:40.034386 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-64f6e33a-b936-4060-9366-1ccb6d44a16e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:40.040433 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-64f6e33a-b936-4060-9366-1ccb6d44a16e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:40.040433 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-64f6e33a-b936-4060-9366-1ccb6d44a16e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:40.040433 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-64f6e33a-b936-4060-9366-1ccb6d44a16e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:40.176706 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-64f6e33a-b936-4060-9366-1ccb6d44a16e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:40.185341 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-64f6e33a-b936-4060-9366-1ccb6d44a16e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:40.187295 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-64f6e33a-b936-4060-9366-1ccb6d44a16e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:40.188640 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-64f6e33a-b936-4060-9366-1ccb6d44a16e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.165101 Feb 04 18:06:40.189208 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 400/800] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:40 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:40.449070 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e5f371db-49bc-453b-9432-38e50892288a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:40.449831 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-e5f371db-49bc-453b-9432-38e50892288a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:40.456517 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e5f371db-49bc-453b-9432-38e50892288a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:40.456974 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e5f371db-49bc-453b-9432-38e50892288a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:40.457748 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e5f371db-49bc-453b-9432-38e50892288a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:40.458194 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e5f371db-49bc-453b-9432-38e50892288a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:40.595243 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e5f371db-49bc-453b-9432-38e50892288a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:40.602549 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e5f371db-49bc-453b-9432-38e50892288a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1318 microversion: 2.1 time: 0.157544 Feb 04 18:06:40.603138 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 401/801] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:40 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:06:41.213068 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-80426dd8-f028-458d-812e-0995a66db177 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:41.213782 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-80426dd8-f028-458d-812e-0995a66db177 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:41.221265 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-80426dd8-f028-458d-812e-0995a66db177 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:41.221719 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-80426dd8-f028-458d-812e-0995a66db177 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:41.222608 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-80426dd8-f028-458d-812e-0995a66db177 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:41.223230 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-80426dd8-f028-458d-812e-0995a66db177 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:41.361423 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-80426dd8-f028-458d-812e-0995a66db177 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:41.370505 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-80426dd8-f028-458d-812e-0995a66db177 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:41.372128 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-80426dd8-f028-458d-812e-0995a66db177 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:41.374095 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-80426dd8-f028-458d-812e-0995a66db177 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.164605 Feb 04 18:06:41.374689 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 401/802] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:41 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:06:41.619503 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-24ae933f-d479-4b95-ac84-c573ae489da2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:41.620117 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-24ae933f-d479-4b95-ac84-c573ae489da2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:41.626447 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-24ae933f-d479-4b95-ac84-c573ae489da2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:41.626905 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-24ae933f-d479-4b95-ac84-c573ae489da2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:41.627691 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-24ae933f-d479-4b95-ac84-c573ae489da2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:41.628131 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-24ae933f-d479-4b95-ac84-c573ae489da2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:41.760163 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-24ae933f-d479-4b95-ac84-c573ae489da2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:41.767972 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-24ae933f-d479-4b95-ac84-c573ae489da2 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1318 microversion: 2.1 time: 0.152404 Feb 04 18:06:41.768566 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 402/803] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:41 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:06:42.393183 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-500cd32f-3e23-41c2-a15b-eed5435f835b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:42.393762 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-500cd32f-3e23-41c2-a15b-eed5435f835b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:42.400210 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-500cd32f-3e23-41c2-a15b-eed5435f835b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:42.400658 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-500cd32f-3e23-41c2-a15b-eed5435f835b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:42.401429 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-500cd32f-3e23-41c2-a15b-eed5435f835b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:42.401862 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-500cd32f-3e23-41c2-a15b-eed5435f835b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:42.534796 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-500cd32f-3e23-41c2-a15b-eed5435f835b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:42.543267 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-500cd32f-3e23-41c2-a15b-eed5435f835b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:42.544765 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-500cd32f-3e23-41c2-a15b-eed5435f835b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:42.545979 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-500cd32f-3e23-41c2-a15b-eed5435f835b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.157165 Feb 04 18:06:42.546582 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 402/804] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:42 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:42.784832 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-bc3bd070-c877-413b-9113-7caef9a841fd tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:42.785471 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-bc3bd070-c877-413b-9113-7caef9a841fd tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:42.791711 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bc3bd070-c877-413b-9113-7caef9a841fd tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:42.792166 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bc3bd070-c877-413b-9113-7caef9a841fd tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:42.792940 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bc3bd070-c877-413b-9113-7caef9a841fd tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:42.793378 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bc3bd070-c877-413b-9113-7caef9a841fd tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:42.929183 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-bc3bd070-c877-413b-9113-7caef9a841fd tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:42.936491 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-bc3bd070-c877-413b-9113-7caef9a841fd tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1318 microversion: 2.1 time: 0.155359 Feb 04 18:06:42.937060 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 403/805] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:42 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:06:43.563722 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-401131fe-cfb5-44ef-910a-7c6b4b9a0332 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:43.564365 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-401131fe-cfb5-44ef-910a-7c6b4b9a0332 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:43.570709 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-401131fe-cfb5-44ef-910a-7c6b4b9a0332 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:43.571162 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-401131fe-cfb5-44ef-910a-7c6b4b9a0332 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:43.571944 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-401131fe-cfb5-44ef-910a-7c6b4b9a0332 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:43.572383 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-401131fe-cfb5-44ef-910a-7c6b4b9a0332 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:43.704134 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-401131fe-cfb5-44ef-910a-7c6b4b9a0332 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:43.713074 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-401131fe-cfb5-44ef-910a-7c6b4b9a0332 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:43.714606 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-401131fe-cfb5-44ef-910a-7c6b4b9a0332 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:43.715762 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-401131fe-cfb5-44ef-910a-7c6b4b9a0332 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.155796 Feb 04 18:06:43.716318 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 403/806] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:43 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:43.952867 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-ef32bd75-9cd7-4611-acef-c772b6f5a030 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:43.953924 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-ef32bd75-9cd7-4611-acef-c772b6f5a030 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:43.959887 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ef32bd75-9cd7-4611-acef-c772b6f5a030 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:43.960338 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ef32bd75-9cd7-4611-acef-c772b6f5a030 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:43.961111 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ef32bd75-9cd7-4611-acef-c772b6f5a030 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:43.961547 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ef32bd75-9cd7-4611-acef-c772b6f5a030 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:44.103668 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ef32bd75-9cd7-4611-acef-c772b6f5a030 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:44.111208 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-ef32bd75-9cd7-4611-acef-c772b6f5a030 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1318 microversion: 2.1 time: 0.162066 Feb 04 18:06:44.111776 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 404/807] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:43 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:06:44.734559 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-68c33947-109d-4ff1-956e-ebb4cce5523a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:44.735309 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-68c33947-109d-4ff1-956e-ebb4cce5523a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:44.742460 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-68c33947-109d-4ff1-956e-ebb4cce5523a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:44.742916 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-68c33947-109d-4ff1-956e-ebb4cce5523a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:44.743692 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-68c33947-109d-4ff1-956e-ebb4cce5523a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:44.744128 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-68c33947-109d-4ff1-956e-ebb4cce5523a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:44.885964 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-68c33947-109d-4ff1-956e-ebb4cce5523a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:44.895453 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-68c33947-109d-4ff1-956e-ebb4cce5523a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:44.896963 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-68c33947-109d-4ff1-956e-ebb4cce5523a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:44.898270 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-68c33947-109d-4ff1-956e-ebb4cce5523a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.167493 Feb 04 18:06:44.898876 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 404/808] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:44 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:45.127358 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-26e8e615-2dd4-4ea5-8cb4-3c2f59095e9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:45.127895 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-26e8e615-2dd4-4ea5-8cb4-3c2f59095e9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:45.134134 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-26e8e615-2dd4-4ea5-8cb4-3c2f59095e9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:45.134621 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-26e8e615-2dd4-4ea5-8cb4-3c2f59095e9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:45.135421 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-26e8e615-2dd4-4ea5-8cb4-3c2f59095e9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:45.135863 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-26e8e615-2dd4-4ea5-8cb4-3c2f59095e9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:45.274577 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-26e8e615-2dd4-4ea5-8cb4-3c2f59095e9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:45.283386 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-26e8e615-2dd4-4ea5-8cb4-3c2f59095e9d tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1318 microversion: 2.1 time: 0.159636 Feb 04 18:06:45.284206 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 405/809] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:45 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:06:45.917078 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-2364b5f7-b30d-4304-8497-7f727c87ac05 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:45.917685 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-2364b5f7-b30d-4304-8497-7f727c87ac05 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:45.924529 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2364b5f7-b30d-4304-8497-7f727c87ac05 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:45.924972 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2364b5f7-b30d-4304-8497-7f727c87ac05 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:45.925743 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2364b5f7-b30d-4304-8497-7f727c87ac05 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:45.926176 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2364b5f7-b30d-4304-8497-7f727c87ac05 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:46.062402 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2364b5f7-b30d-4304-8497-7f727c87ac05 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:46.071133 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2364b5f7-b30d-4304-8497-7f727c87ac05 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:46.072649 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2364b5f7-b30d-4304-8497-7f727c87ac05 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:46.073801 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-2364b5f7-b30d-4304-8497-7f727c87ac05 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.160447 Feb 04 18:06:46.074371 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 405/810] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:45 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:46.300634 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-cc5a6a93-6ee7-4297-bd85-e051da606fae tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:46.301408 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-cc5a6a93-6ee7-4297-bd85-e051da606fae tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:46.307719 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cc5a6a93-6ee7-4297-bd85-e051da606fae tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:46.308176 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cc5a6a93-6ee7-4297-bd85-e051da606fae tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:46.308958 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cc5a6a93-6ee7-4297-bd85-e051da606fae tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:46.309398 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cc5a6a93-6ee7-4297-bd85-e051da606fae tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:46.446718 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-cc5a6a93-6ee7-4297-bd85-e051da606fae tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:46.454032 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-cc5a6a93-6ee7-4297-bd85-e051da606fae tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1318 microversion: 2.1 time: 0.157195 Feb 04 18:06:46.454638 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 406/811] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:46 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:06:47.092874 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-c7751a99-5231-4b90-b685-f8b0d9b69564 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:47.093570 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-c7751a99-5231-4b90-b685-f8b0d9b69564 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:47.100612 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c7751a99-5231-4b90-b685-f8b0d9b69564 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:47.101331 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c7751a99-5231-4b90-b685-f8b0d9b69564 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:47.102129 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c7751a99-5231-4b90-b685-f8b0d9b69564 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:47.102610 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c7751a99-5231-4b90-b685-f8b0d9b69564 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:47.374368 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c7751a99-5231-4b90-b685-f8b0d9b69564 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:47.374368 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c7751a99-5231-4b90-b685-f8b0d9b69564 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:47.376330 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c7751a99-5231-4b90-b685-f8b0d9b69564 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:47.376330 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-c7751a99-5231-4b90-b685-f8b0d9b69564 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.180548 Feb 04 18:06:47.376330 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 406/812] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:47 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:47.471244 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-5e2cd415-64f3-4bcb-b258-d9a23c144660 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:47.471839 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-5e2cd415-64f3-4bcb-b258-d9a23c144660 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:47.478576 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5e2cd415-64f3-4bcb-b258-d9a23c144660 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:47.479084 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5e2cd415-64f3-4bcb-b258-d9a23c144660 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:47.479897 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5e2cd415-64f3-4bcb-b258-d9a23c144660 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:47.480422 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5e2cd415-64f3-4bcb-b258-d9a23c144660 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:47.612638 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5e2cd415-64f3-4bcb-b258-d9a23c144660 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:47.620637 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-5e2cd415-64f3-4bcb-b258-d9a23c144660 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1318 microversion: 2.1 time: 0.153076 Feb 04 18:06:47.621256 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 407/813] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:47 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:06:48.287123 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-930c93d0-832f-43ab-89da-b75d782fb283 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:48.287733 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-930c93d0-832f-43ab-89da-b75d782fb283 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:48.293581 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-930c93d0-832f-43ab-89da-b75d782fb283 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:48.294046 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-930c93d0-832f-43ab-89da-b75d782fb283 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:48.294906 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-930c93d0-832f-43ab-89da-b75d782fb283 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:48.295344 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-930c93d0-832f-43ab-89da-b75d782fb283 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:48.435824 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-930c93d0-832f-43ab-89da-b75d782fb283 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:48.445076 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-930c93d0-832f-43ab-89da-b75d782fb283 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:48.446631 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-930c93d0-832f-43ab-89da-b75d782fb283 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:48.447778 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-930c93d0-832f-43ab-89da-b75d782fb283 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.164698 Feb 04 18:06:48.448339 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 407/814] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:48 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:48.639829 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-dad18257-aae9-4625-a880-daf9c62596d1 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:48.641287 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-dad18257-aae9-4625-a880-daf9c62596d1 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:48.648440 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dad18257-aae9-4625-a880-daf9c62596d1 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:48.649059 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dad18257-aae9-4625-a880-daf9c62596d1 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:48.649882 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dad18257-aae9-4625-a880-daf9c62596d1 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:48.650397 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dad18257-aae9-4625-a880-daf9c62596d1 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:48.802223 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-dad18257-aae9-4625-a880-daf9c62596d1 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:48.809751 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-dad18257-aae9-4625-a880-daf9c62596d1 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1318 microversion: 2.1 time: 0.174908 Feb 04 18:06:48.810326 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 408/815] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:48 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:06:48.868308 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-8ea100cd-4d3c-4d38-b903-8ea6eff5e8e0 req-9e16e406-6bc3-40b1-b618-1ccbbede6908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd", "name": "network-vif-plugged", "status": "completed", "tag": "a40a8554-e208-44a5-a81c-393bb0866fff"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:06:48.869905 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:06:48.869905 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:06:48.878054 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-8ea100cd-4d3c-4d38-b903-8ea6eff5e8e0 req-9e16e406-6bc3-40b1-b618-1ccbbede6908 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:48.878640 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-8ea100cd-4d3c-4d38-b903-8ea6eff5e8e0 req-9e16e406-6bc3-40b1-b618-1ccbbede6908 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:48.892300 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-8ea100cd-4d3c-4d38-b903-8ea6eff5e8e0 req-9e16e406-6bc3-40b1-b618-1ccbbede6908 service nova] Creating event network-vif-plugged:a40a8554-e208-44a5-a81c-393bb0866fff for instance 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd on hv-cinder-82276 Feb 04 18:06:48.897556 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-8ea100cd-4d3c-4d38-b903-8ea6eff5e8e0 req-9e16e406-6bc3-40b1-b618-1ccbbede6908 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166701 Feb 04 18:06:48.907308 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 408/816] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:06:49.466403 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-001519d5-c539-44f3-9fa0-8fa259f9ace8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:49.467158 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-001519d5-c539-44f3-9fa0-8fa259f9ace8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:49.474135 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-001519d5-c539-44f3-9fa0-8fa259f9ace8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:49.474631 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-001519d5-c539-44f3-9fa0-8fa259f9ace8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:49.475410 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-001519d5-c539-44f3-9fa0-8fa259f9ace8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:49.475840 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-001519d5-c539-44f3-9fa0-8fa259f9ace8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:49.610166 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-001519d5-c539-44f3-9fa0-8fa259f9ace8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:49.618808 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-001519d5-c539-44f3-9fa0-8fa259f9ace8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:49.620337 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-001519d5-c539-44f3-9fa0-8fa259f9ace8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:49.621493 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-001519d5-c539-44f3-9fa0-8fa259f9ace8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.158924 Feb 04 18:06:49.622060 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 409/817] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:49 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:49.829198 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-73dae28a-58b6-4609-9d82-5a35d8cbcef1 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:49.829894 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-73dae28a-58b6-4609-9d82-5a35d8cbcef1 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:49.836589 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-73dae28a-58b6-4609-9d82-5a35d8cbcef1 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:49.837033 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-73dae28a-58b6-4609-9d82-5a35d8cbcef1 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:49.837805 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-73dae28a-58b6-4609-9d82-5a35d8cbcef1 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:49.838239 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-73dae28a-58b6-4609-9d82-5a35d8cbcef1 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:49.975934 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-73dae28a-58b6-4609-9d82-5a35d8cbcef1 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:49.984774 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-73dae28a-58b6-4609-9d82-5a35d8cbcef1 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1318 microversion: 2.1 time: 0.160271 Feb 04 18:06:49.985366 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 409/818] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:49 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:06:50.640280 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-bc9ff751-2c24-4810-bdee-2ad62ea65ef8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:50.640860 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-bc9ff751-2c24-4810-bdee-2ad62ea65ef8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:50.647800 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bc9ff751-2c24-4810-bdee-2ad62ea65ef8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:50.648303 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bc9ff751-2c24-4810-bdee-2ad62ea65ef8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:50.649335 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bc9ff751-2c24-4810-bdee-2ad62ea65ef8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:50.649776 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bc9ff751-2c24-4810-bdee-2ad62ea65ef8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:50.784827 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-bc9ff751-2c24-4810-bdee-2ad62ea65ef8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:50.793186 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-bc9ff751-2c24-4810-bdee-2ad62ea65ef8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:50.794724 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-bc9ff751-2c24-4810-bdee-2ad62ea65ef8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:50.795887 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-bc9ff751-2c24-4810-bdee-2ad62ea65ef8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.159421 Feb 04 18:06:50.796444 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 410/819] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:50 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:51.001262 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-08cbf5a4-a8fc-4446-ade1-1df5c88d691b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:51.001994 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-08cbf5a4-a8fc-4446-ade1-1df5c88d691b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:51.009529 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-08cbf5a4-a8fc-4446-ade1-1df5c88d691b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:51.009992 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-08cbf5a4-a8fc-4446-ade1-1df5c88d691b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:51.010838 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-08cbf5a4-a8fc-4446-ade1-1df5c88d691b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:51.011283 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-08cbf5a4-a8fc-4446-ade1-1df5c88d691b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:51.159707 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-08cbf5a4-a8fc-4446-ade1-1df5c88d691b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:51.167305 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-08cbf5a4-a8fc-4446-ade1-1df5c88d691b tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1318 microversion: 2.1 time: 0.169994 Feb 04 18:06:51.167869 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 410/820] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:50 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:06:51.813489 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-33967a16-8a03-4ef3-933e-919a5cc379fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:51.814130 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-33967a16-8a03-4ef3-933e-919a5cc379fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:51.820326 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-33967a16-8a03-4ef3-933e-919a5cc379fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:51.820774 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-33967a16-8a03-4ef3-933e-919a5cc379fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:51.821545 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-33967a16-8a03-4ef3-933e-919a5cc379fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:51.821981 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-33967a16-8a03-4ef3-933e-919a5cc379fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:51.956572 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-33967a16-8a03-4ef3-933e-919a5cc379fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:51.965177 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-33967a16-8a03-4ef3-933e-919a5cc379fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:51.968795 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-33967a16-8a03-4ef3-933e-919a5cc379fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:51.968795 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-33967a16-8a03-4ef3-933e-919a5cc379fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.158118 Feb 04 18:06:51.968795 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 411/821] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:51 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:52.184229 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-c39a78cf-a771-4ed5-bd2d-094a0bc0336e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:52.184846 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-c39a78cf-a771-4ed5-bd2d-094a0bc0336e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:52.191626 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c39a78cf-a771-4ed5-bd2d-094a0bc0336e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:52.192078 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c39a78cf-a771-4ed5-bd2d-094a0bc0336e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:52.192877 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c39a78cf-a771-4ed5-bd2d-094a0bc0336e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:52.193310 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c39a78cf-a771-4ed5-bd2d-094a0bc0336e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:52.334809 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c39a78cf-a771-4ed5-bd2d-094a0bc0336e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:52.342118 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-c39a78cf-a771-4ed5-bd2d-094a0bc0336e tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1506 microversion: 2.1 time: 0.161482 Feb 04 18:06:52.342726 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 411/822] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:06:52 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:06:52.359810 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a23fbbb6-c775-4f8d-ad7f-55b3a3ca811a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e83bc03-7a75-44ef-9be4-59e744a70b4c", "device": "/dev/sdb"}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:06:52.361651 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-a23fbbb6-c775-4f8d-ad7f-55b3a3ca811a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:52.368987 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a23fbbb6-c775-4f8d-ad7f-55b3a3ca811a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:52.369610 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a23fbbb6-c775-4f8d-ad7f-55b3a3ca811a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:52.370574 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a23fbbb6-c775-4f8d-ad7f-55b3a3ca811a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:52.371109 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a23fbbb6-c775-4f8d-ad7f-55b3a3ca811a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:52.529916 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-80d5466d-33b1-45cc-9de9-a102e996af1e req-dcaa733c-0f21-441e-95fb-b1490bbd0fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514ca883-72d2-4695-a4b6-47c18ce4add5", "name": "network-vif-plugged", "status": "completed", "tag": "fe3cfe16-c9c7-4dcd-a6bf-b32b9ba77df0"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:06:52.531550 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:06:52.531550 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:06:52.540357 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-80d5466d-33b1-45cc-9de9-a102e996af1e req-dcaa733c-0f21-441e-95fb-b1490bbd0fe5 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:52.540357 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-80d5466d-33b1-45cc-9de9-a102e996af1e req-dcaa733c-0f21-441e-95fb-b1490bbd0fe5 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:52.549552 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-80d5466d-33b1-45cc-9de9-a102e996af1e req-dcaa733c-0f21-441e-95fb-b1490bbd0fe5 service nova] Creating event network-vif-plugged:fe3cfe16-c9c7-4dcd-a6bf-b32b9ba77df0 for instance 514ca883-72d2-4695-a4b6-47c18ce4add5 on hv-cinder-82276 Feb 04 18:06:52.554319 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-80d5466d-33b1-45cc-9de9-a102e996af1e req-dcaa733c-0f21-441e-95fb-b1490bbd0fe5 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028045 Feb 04 18:06:52.555105 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 412/823] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:06:52.988061 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b5d1a130-acba-4614-a1fe-d5652037534b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:52.988795 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-b5d1a130-acba-4614-a1fe-d5652037534b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:52.995563 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b5d1a130-acba-4614-a1fe-d5652037534b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:52.996007 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b5d1a130-acba-4614-a1fe-d5652037534b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:52.996788 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b5d1a130-acba-4614-a1fe-d5652037534b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:52.997219 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b5d1a130-acba-4614-a1fe-d5652037534b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:53.138790 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-b5d1a130-acba-4614-a1fe-d5652037534b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:53.149610 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-b5d1a130-acba-4614-a1fe-d5652037534b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:53.151216 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-b5d1a130-acba-4614-a1fe-d5652037534b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:53.152378 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-b5d1a130-acba-4614-a1fe-d5652037534b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.169033 Feb 04 18:06:53.152949 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 413/824] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:52 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:06:53.420857 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a23fbbb6-c775-4f8d-ad7f-55b3a3ca811a tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "POST /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.065626 Feb 04 18:06:53.421606 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 412/825] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Feb 4 18:06:52 2022] POST /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd/os-volume_attachments => generated 194 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:06:54.171326 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-bfa73f42-a712-4242-8a4d-e4210be981a6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:54.171935 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-bfa73f42-a712-4242-8a4d-e4210be981a6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:54.179204 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bfa73f42-a712-4242-8a4d-e4210be981a6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:54.179652 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bfa73f42-a712-4242-8a4d-e4210be981a6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:54.180481 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bfa73f42-a712-4242-8a4d-e4210be981a6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:54.180991 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bfa73f42-a712-4242-8a4d-e4210be981a6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:54.320935 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-bfa73f42-a712-4242-8a4d-e4210be981a6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:54.329291 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-bfa73f42-a712-4242-8a4d-e4210be981a6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:54.331471 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-bfa73f42-a712-4242-8a4d-e4210be981a6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:54.332766 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-bfa73f42-a712-4242-8a4d-e4210be981a6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.165128 Feb 04 18:06:54.333396 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 414/826] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:54 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:55.350227 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e0e9d25c-8b4c-49bc-8aca-0594009e1e3d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:55.352181 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-e0e9d25c-8b4c-49bc-8aca-0594009e1e3d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:55.359197 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e0e9d25c-8b4c-49bc-8aca-0594009e1e3d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:55.359725 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e0e9d25c-8b4c-49bc-8aca-0594009e1e3d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:55.360526 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e0e9d25c-8b4c-49bc-8aca-0594009e1e3d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:55.360968 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e0e9d25c-8b4c-49bc-8aca-0594009e1e3d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:55.506278 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e0e9d25c-8b4c-49bc-8aca-0594009e1e3d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:55.514536 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e0e9d25c-8b4c-49bc-8aca-0594009e1e3d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:55.516062 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e0e9d25c-8b4c-49bc-8aca-0594009e1e3d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:55.517287 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e0e9d25c-8b4c-49bc-8aca-0594009e1e3d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.171081 Feb 04 18:06:55.518488 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 413/827] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:55 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:56.536342 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-17afad53-1e24-4947-b1ca-8143aa147479 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:56.537876 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-17afad53-1e24-4947-b1ca-8143aa147479 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:56.543932 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-17afad53-1e24-4947-b1ca-8143aa147479 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:56.544523 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-17afad53-1e24-4947-b1ca-8143aa147479 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:56.545583 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-17afad53-1e24-4947-b1ca-8143aa147479 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:56.546184 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-17afad53-1e24-4947-b1ca-8143aa147479 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:56.683993 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-17afad53-1e24-4947-b1ca-8143aa147479 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:56.692817 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-17afad53-1e24-4947-b1ca-8143aa147479 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:56.694320 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-17afad53-1e24-4947-b1ca-8143aa147479 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:56.695536 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-17afad53-1e24-4947-b1ca-8143aa147479 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.163044 Feb 04 18:06:56.696105 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 415/828] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:56 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:57.713934 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-63282c4e-c9b5-42cb-b0d0-3c03d316d05d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:57.714572 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-63282c4e-c9b5-42cb-b0d0-3c03d316d05d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:57.720803 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-63282c4e-c9b5-42cb-b0d0-3c03d316d05d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:57.721292 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-63282c4e-c9b5-42cb-b0d0-3c03d316d05d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:57.722182 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-63282c4e-c9b5-42cb-b0d0-3c03d316d05d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:57.722656 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-63282c4e-c9b5-42cb-b0d0-3c03d316d05d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:57.860621 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-63282c4e-c9b5-42cb-b0d0-3c03d316d05d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:57.869151 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-63282c4e-c9b5-42cb-b0d0-3c03d316d05d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:57.870677 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-63282c4e-c9b5-42cb-b0d0-3c03d316d05d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:57.871843 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-63282c4e-c9b5-42cb-b0d0-3c03d316d05d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1806 microversion: 2.20 time: 0.161543 Feb 04 18:06:57.872411 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 414/829] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:57 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:06:58.891569 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-d526a5b0-96fe-40fc-bf85-95f14485f42f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:06:58.892172 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-d526a5b0-96fe-40fc-bf85-95f14485f42f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:06:58.898379 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d526a5b0-96fe-40fc-bf85-95f14485f42f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:58.898894 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d526a5b0-96fe-40fc-bf85-95f14485f42f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:58.899655 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d526a5b0-96fe-40fc-bf85-95f14485f42f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:06:58.900104 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d526a5b0-96fe-40fc-bf85-95f14485f42f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:06:59.042924 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-d526a5b0-96fe-40fc-bf85-95f14485f42f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:59.051218 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-d526a5b0-96fe-40fc-bf85-95f14485f42f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:59.052723 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-d526a5b0-96fe-40fc-bf85-95f14485f42f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:06:59.053867 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-d526a5b0-96fe-40fc-bf85-95f14485f42f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1793 microversion: 2.20 time: 0.166048 Feb 04 18:06:59.054452 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 416/830] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:06:58 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1793 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:07:25.753300 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-9a38ba72-397d-46fe-970d-9be5ace4d719 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:07:25.753817 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-9a38ba72-397d-46fe-970d-9be5ace4d719 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:07:25.760046 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9a38ba72-397d-46fe-970d-9be5ace4d719 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:07:25.760498 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9a38ba72-397d-46fe-970d-9be5ace4d719 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:07:25.761282 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9a38ba72-397d-46fe-970d-9be5ace4d719 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:07:25.761725 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9a38ba72-397d-46fe-970d-9be5ace4d719 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:07:25.840422 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.objects.instance [None req-9a38ba72-397d-46fe-970d-9be5ace4d719 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lazy-loading 'services' on Instance uuid 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd {{(pid=123567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:07:26.169842 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-9a38ba72-397d-46fe-970d-9be5ace4d719 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "DELETE /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd/os-volume_attachments/1e83bc03-7a75-44ef-9be4-59e744a70b4c" status: 202 len: 0 microversion: 2.1 time: 0.420135 Feb 04 18:07:26.170487 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 415/831] 10.222.0.98 () {58 vars in 1415 bytes} [Fri Feb 4 18:07:25 2022] DELETE /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd/os-volume_attachments/1e83bc03-7a75-44ef-9be4-59e744a70b4c => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 04 18:07:36.722281 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-a66962ee-9c73-4ed7-b113-cac4f5433cff tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:07:36.722806 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-a66962ee-9c73-4ed7-b113-cac4f5433cff tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:07:36.728656 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a66962ee-9c73-4ed7-b113-cac4f5433cff tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:07:36.729108 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a66962ee-9c73-4ed7-b113-cac4f5433cff tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:07:36.730437 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a66962ee-9c73-4ed7-b113-cac4f5433cff tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:07:36.730876 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a66962ee-9c73-4ed7-b113-cac4f5433cff tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:07:36.757402 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-a66962ee-9c73-4ed7-b113-cac4f5433cff tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Going to try to terminate instance {{(pid=123566) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 04 18:07:37.113253 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-a66962ee-9c73-4ed7-b113-cac4f5433cff tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "DELETE /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 204 len: 0 microversion: 2.1 time: 0.394397 Feb 04 18:07:37.113849 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 417/832] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Feb 4 18:07:36 2022] DELETE /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 04 18:07:37.123016 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-1a33ce99-09a5-4a0d-b6de-e19458e6a831 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:07:37.123707 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-1a33ce99-09a5-4a0d-b6de-e19458e6a831 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:07:37.129820 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1a33ce99-09a5-4a0d-b6de-e19458e6a831 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:07:37.130263 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1a33ce99-09a5-4a0d-b6de-e19458e6a831 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:07:37.131063 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1a33ce99-09a5-4a0d-b6de-e19458e6a831 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:07:37.131493 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1a33ce99-09a5-4a0d-b6de-e19458e6a831 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:07:37.264726 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-1a33ce99-09a5-4a0d-b6de-e19458e6a831 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:07:37.272071 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-1a33ce99-09a5-4a0d-b6de-e19458e6a831 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1512 microversion: 2.1 time: 0.153614 Feb 04 18:07:37.272638 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 416/833] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:07:37 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:07:38.289929 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ae11aef5-4544-4717-82d8-b256ce4e4143 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:07:38.290669 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ae11aef5-4544-4717-82d8-b256ce4e4143 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:07:38.297791 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ae11aef5-4544-4717-82d8-b256ce4e4143 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:07:38.298246 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ae11aef5-4544-4717-82d8-b256ce4e4143 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:07:38.299055 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ae11aef5-4544-4717-82d8-b256ce4e4143 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:07:38.299496 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ae11aef5-4544-4717-82d8-b256ce4e4143 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:07:38.435174 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-ae11aef5-4544-4717-82d8-b256ce4e4143 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:07:38.442648 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ae11aef5-4544-4717-82d8-b256ce4e4143 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1512 microversion: 2.1 time: 0.156777 Feb 04 18:07:38.443209 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 418/834] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:07:38 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:07:39.460001 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-7cdcf7c6-cb7a-4e00-af99-b8276741faf6 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:07:39.460615 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-7cdcf7c6-cb7a-4e00-af99-b8276741faf6 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:07:39.467123 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7cdcf7c6-cb7a-4e00-af99-b8276741faf6 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:07:39.467582 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7cdcf7c6-cb7a-4e00-af99-b8276741faf6 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:07:39.468371 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7cdcf7c6-cb7a-4e00-af99-b8276741faf6 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:07:39.468843 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7cdcf7c6-cb7a-4e00-af99-b8276741faf6 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:07:39.602153 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-7cdcf7c6-cb7a-4e00-af99-b8276741faf6 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:07:39.610269 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-7cdcf7c6-cb7a-4e00-af99-b8276741faf6 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1512 microversion: 2.1 time: 0.153914 Feb 04 18:07:39.610890 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 417/835] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:07:39 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:07:40.029121 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-53aeed70-50f9-4117-9fdd-cbfa8c4ddd77 req-ae3fa34f-bb60-45a5-b927-eef62b6185d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd", "name": "network-vif-deleted", "tag": "a40a8554-e208-44a5-a81c-393bb0866fff"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:07:40.030678 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:07:40.030678 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:07:40.038117 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-53aeed70-50f9-4117-9fdd-cbfa8c4ddd77 req-ae3fa34f-bb60-45a5-b927-eef62b6185d4 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:07:40.038590 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-53aeed70-50f9-4117-9fdd-cbfa8c4ddd77 req-ae3fa34f-bb60-45a5-b927-eef62b6185d4 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:07:40.049942 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-53aeed70-50f9-4117-9fdd-cbfa8c4ddd77 req-ae3fa34f-bb60-45a5-b927-eef62b6185d4 service nova] Creating event network-vif-deleted:a40a8554-e208-44a5-a81c-393bb0866fff for instance 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd on hv-cinder-82276 Feb 04 18:07:40.054913 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-53aeed70-50f9-4117-9fdd-cbfa8c4ddd77 req-ae3fa34f-bb60-45a5-b927-eef62b6185d4 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029856 Feb 04 18:07:40.055487 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 419/836] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:07:40.627708 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-6ddf9a43-d19f-4a94-b469-ed51d803c4e4 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:07:40.628348 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-6ddf9a43-d19f-4a94-b469-ed51d803c4e4 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:07:40.634833 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6ddf9a43-d19f-4a94-b469-ed51d803c4e4 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:07:40.635286 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6ddf9a43-d19f-4a94-b469-ed51d803c4e4 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:07:40.636730 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6ddf9a43-d19f-4a94-b469-ed51d803c4e4 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:07:40.637177 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6ddf9a43-d19f-4a94-b469-ed51d803c4e4 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:07:40.668468 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6ddf9a43-d19f-4a94-b469-ed51d803c4e4 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:07:40.668918 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6ddf9a43-d19f-4a94-b469-ed51d803c4e4 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:07:40.669370 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.objects.instance [None req-6ddf9a43-d19f-4a94-b469-ed51d803c4e4 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lazy-loading 'fault' on Instance uuid 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd {{(pid=123567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:07:40.708736 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-6ddf9a43-d19f-4a94-b469-ed51d803c4e4 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8827f98ae4e1085ac670f76898113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4531047cd4d73a0ccd2807d2a282e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:07:40.715980 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-6ddf9a43-d19f-4a94-b469-ed51d803c4e4 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 200 len: 1308 microversion: 2.1 time: 0.092088 Feb 04 18:07:40.716540 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 418/837] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:07:40 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:07:41.733892 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-d0ca019b-8497-47f7-9c27-7fdb98bb59c6 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:07:41.734657 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-d0ca019b-8497-47f7-9c27-7fdb98bb59c6 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] [instance: 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:07:41.741264 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d0ca019b-8497-47f7-9c27-7fdb98bb59c6 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:07:41.741711 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d0ca019b-8497-47f7-9c27-7fdb98bb59c6 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:07:41.742521 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d0ca019b-8497-47f7-9c27-7fdb98bb59c6 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:07:41.742965 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d0ca019b-8497-47f7-9c27-7fdb98bb59c6 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:07:41.756029 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-d0ca019b-8497-47f7-9c27-7fdb98bb59c6 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] HTTP exception thrown: Instance 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd could not be found. Feb 04 18:07:41.756683 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-d0ca019b-8497-47f7-9c27-7fdb98bb59c6 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] Returning 404 to user: Instance 8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd could not be found. {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:07:41.757502 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-d0ca019b-8497-47f7-9c27-7fdb98bb59c6 tempest-VolumesSnapshotTestJSON-942485386 tempest-VolumesSnapshotTestJSON-942485386-project] 10.222.0.98 "GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd" status: 404 len: 111 microversion: 2.1 time: 0.028328 Feb 04 18:07:41.758042 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 420/838] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:07:41 2022] GET /compute/v2.1/servers/8260d9c8-e4b6-4a33-b01e-c23fce3ab4bd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:08:07.826813 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a709b065-9741-4707-b525-66f72796a1cd tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Action: 'create', calling method: .version_select at 0x7fe8d0c73c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-189574940"}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:08:07.848519 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-a709b065-9741-4707-b525-66f72796a1cd tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Getting quotas for project 369ffaf0cb1e4d2f913bfd52d63bf010. Resources: {'key_pairs'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:08:07.852600 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-a709b065-9741-4707-b525-66f72796a1cd tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Getting quotas for user 1eaad40ced6942a2bb04356175706b3c and project 369ffaf0cb1e4d2f913bfd52d63bf010. Resources: {'key_pairs'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:08:08.294239 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-a709b065-9741-4707-b525-66f72796a1cd tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Getting quotas for project 369ffaf0cb1e4d2f913bfd52d63bf010. Resources: {'key_pairs'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:08:08.297845 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-a709b065-9741-4707-b525-66f72796a1cd tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Getting quotas for user 1eaad40ced6942a2bb04356175706b3c and project 369ffaf0cb1e4d2f913bfd52d63bf010. Resources: {'key_pairs'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:08:08.311284 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a709b065-9741-4707-b525-66f72796a1cd tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.488133 Feb 04 18:08:08.312122 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 419/839] 10.222.0.98 () {60 vars in 1157 bytes} [Fri Feb 4 18:08:07 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:08.361941 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-40341200-e61f-41f9-b2c0-6c3a2e37912b tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-454420808", "imageRef": "d77802df-0c00-4c34-8fc3-ad112fd76e3c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-189574940", "networks": [{"uuid": "b3d8abd3-2554-4b7a-aecc-468588597521"}]}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:08:08.411363 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.network.neutron [None req-40341200-e61f-41f9-b2c0-6c3a2e37912b tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] validate_networks() for [('b3d8abd3-2554-4b7a-aecc-468588597521', None, None, None, None, None)] {{(pid=123566) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 04 18:08:08.790732 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-40341200-e61f-41f9-b2c0-6c3a2e37912b tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Flavor limits 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 04 18:08:08.791169 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-40341200-e61f-41f9-b2c0-6c3a2e37912b tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Image limits 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 04 18:08:08.791676 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-40341200-e61f-41f9-b2c0-6c3a2e37912b tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Flavor pref 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 04 18:08:08.792090 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-40341200-e61f-41f9-b2c0-6c3a2e37912b tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Image pref 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 04 18:08:08.792509 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-40341200-e61f-41f9-b2c0-6c3a2e37912b tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 04 18:08:08.802310 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-40341200-e61f-41f9-b2c0-6c3a2e37912b tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:08.802809 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-40341200-e61f-41f9-b2c0-6c3a2e37912b tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:08.803619 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-40341200-e61f-41f9-b2c0-6c3a2e37912b tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:08.804077 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-40341200-e61f-41f9-b2c0-6c3a2e37912b tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:08.821100 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-40341200-e61f-41f9-b2c0-6c3a2e37912b tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Getting quotas for project 369ffaf0cb1e4d2f913bfd52d63bf010. Resources: {'cores', 'ram', 'instances'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:08:08.826218 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-40341200-e61f-41f9-b2c0-6c3a2e37912b tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Getting quotas for user 1eaad40ced6942a2bb04356175706b3c and project 369ffaf0cb1e4d2f913bfd52d63bf010. Resources: {'cores', 'ram', 'instances'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:08:08.839299 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-40341200-e61f-41f9-b2c0-6c3a2e37912b tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Going to run 1 instances... {{(pid=123566) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 04 18:08:08.841777 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-40341200-e61f-41f9-b2c0-6c3a2e37912b tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d77802df-0c00-4c34-8fc3-ad112fd76e3c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 04 18:08:09.000389 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-40341200-e61f-41f9-b2c0-6c3a2e37912b tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642238 Feb 04 18:08:09.001108 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 421/840] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Feb 4 18:08:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 04 18:08:09.011394 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3975bdc8-fb82-4560-8676-dc8b6d8e8f7e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:09.012156 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-3975bdc8-fb82-4560-8676-dc8b6d8e8f7e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:09.067325 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-3975bdc8-fb82-4560-8676-dc8b6d8e8f7e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:09.075431 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-3975bdc8-fb82-4560-8676-dc8b6d8e8f7e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1257 microversion: 2.1 time: 0.068131 Feb 04 18:08:09.084727 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 420/841] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:09 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1257 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:08:10.093089 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-c0701bac-59d5-4c28-803a-aa4f618a1ac9 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:10.093695 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-c0701bac-59d5-4c28-803a-aa4f618a1ac9 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:10.145948 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c0701bac-59d5-4c28-803a-aa4f618a1ac9 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:10.153783 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-c0701bac-59d5-4c28-803a-aa4f618a1ac9 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1257 microversion: 2.1 time: 0.065863 Feb 04 18:08:10.154344 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 422/842] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:10 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1257 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:11.170965 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-68060490-adc1-475e-bdab-2edbbd568f8c tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:11.174558 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-68060490-adc1-475e-bdab-2edbbd568f8c tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:11.177937 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-68060490-adc1-475e-bdab-2edbbd568f8c tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:11.178361 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-68060490-adc1-475e-bdab-2edbbd568f8c tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:11.179165 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-68060490-adc1-475e-bdab-2edbbd568f8c tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:11.179596 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-68060490-adc1-475e-bdab-2edbbd568f8c tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:11.240427 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-68060490-adc1-475e-bdab-2edbbd568f8c tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:11.249262 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-68060490-adc1-475e-bdab-2edbbd568f8c tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1309 microversion: 2.1 time: 0.082863 Feb 04 18:08:11.249887 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 421/843] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:11 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1309 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:12.271926 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-937cc389-893d-4e18-a6e4-a0996078fa84 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:12.273070 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-937cc389-893d-4e18-a6e4-a0996078fa84 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:12.283381 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-937cc389-893d-4e18-a6e4-a0996078fa84 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:12.284223 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-937cc389-893d-4e18-a6e4-a0996078fa84 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:12.285491 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-937cc389-893d-4e18-a6e4-a0996078fa84 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:12.286205 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-937cc389-893d-4e18-a6e4-a0996078fa84 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:12.354790 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-937cc389-893d-4e18-a6e4-a0996078fa84 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:12.362674 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-937cc389-893d-4e18-a6e4-a0996078fa84 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1315 microversion: 2.1 time: 0.097937 Feb 04 18:08:12.372981 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 423/844] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:12 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1315 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:13.379566 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-fbca4edc-ed44-4abf-a6b8-620eb7edd868 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:13.380797 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-fbca4edc-ed44-4abf-a6b8-620eb7edd868 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:13.393596 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fbca4edc-ed44-4abf-a6b8-620eb7edd868 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:13.394503 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fbca4edc-ed44-4abf-a6b8-620eb7edd868 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:13.395595 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fbca4edc-ed44-4abf-a6b8-620eb7edd868 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:13.396251 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fbca4edc-ed44-4abf-a6b8-620eb7edd868 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:13.788105 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-fbca4edc-ed44-4abf-a6b8-620eb7edd868 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:13.795993 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-fbca4edc-ed44-4abf-a6b8-620eb7edd868 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1357 microversion: 2.1 time: 0.420115 Feb 04 18:08:13.796635 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 422/845] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:13 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1357 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:14.813188 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-35c0b5e3-e2ec-4f49-b4da-461c2368512d tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:14.814025 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-35c0b5e3-e2ec-4f49-b4da-461c2368512d tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:14.820561 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-35c0b5e3-e2ec-4f49-b4da-461c2368512d tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:14.821383 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-35c0b5e3-e2ec-4f49-b4da-461c2368512d tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:14.822458 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-35c0b5e3-e2ec-4f49-b4da-461c2368512d tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:14.823610 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-35c0b5e3-e2ec-4f49-b4da-461c2368512d tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:14.985426 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-35c0b5e3-e2ec-4f49-b4da-461c2368512d tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:14.995338 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-35c0b5e3-e2ec-4f49-b4da-461c2368512d tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1357 microversion: 2.1 time: 0.185424 Feb 04 18:08:15.004733 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 424/846] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:14 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:16.012268 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-03c65577-d3ea-411e-811d-c7287a49a7e1 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:16.012889 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-03c65577-d3ea-411e-811d-c7287a49a7e1 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:16.019489 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-03c65577-d3ea-411e-811d-c7287a49a7e1 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:16.020214 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-03c65577-d3ea-411e-811d-c7287a49a7e1 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:16.021189 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-03c65577-d3ea-411e-811d-c7287a49a7e1 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:16.021798 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-03c65577-d3ea-411e-811d-c7287a49a7e1 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:16.221182 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-03c65577-d3ea-411e-811d-c7287a49a7e1 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:16.245648 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-03c65577-d3ea-411e-811d-c7287a49a7e1 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1357 microversion: 2.1 time: 0.236968 Feb 04 18:08:16.246329 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 423/847] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:16 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1357 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:17.264129 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-c9380bea-2ab8-4e48-9fc7-798b1a569476 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:17.264756 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-c9380bea-2ab8-4e48-9fc7-798b1a569476 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:17.272326 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c9380bea-2ab8-4e48-9fc7-798b1a569476 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:17.273133 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c9380bea-2ab8-4e48-9fc7-798b1a569476 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:17.274198 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c9380bea-2ab8-4e48-9fc7-798b1a569476 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:17.274930 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c9380bea-2ab8-4e48-9fc7-798b1a569476 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:17.455460 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c9380bea-2ab8-4e48-9fc7-798b1a569476 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:17.468360 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-c9380bea-2ab8-4e48-9fc7-798b1a569476 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1357 microversion: 2.1 time: 0.208791 Feb 04 18:08:17.469601 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 425/848] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:17 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1357 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:18.485605 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e55a3bc5-c9a6-4e1e-8d6a-cb53cf1ac62e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:18.486860 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-e55a3bc5-c9a6-4e1e-8d6a-cb53cf1ac62e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:18.494164 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e55a3bc5-c9a6-4e1e-8d6a-cb53cf1ac62e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:18.494748 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e55a3bc5-c9a6-4e1e-8d6a-cb53cf1ac62e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:18.495557 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e55a3bc5-c9a6-4e1e-8d6a-cb53cf1ac62e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:18.495998 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e55a3bc5-c9a6-4e1e-8d6a-cb53cf1ac62e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:18.684105 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e55a3bc5-c9a6-4e1e-8d6a-cb53cf1ac62e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:18.691661 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e55a3bc5-c9a6-4e1e-8d6a-cb53cf1ac62e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1357 microversion: 2.1 time: 0.210080 Feb 04 18:08:18.692501 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 424/849] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:18 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1357 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:08:19.715359 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-2cc9ec19-b5d2-433e-a294-113edfd34cfa tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:19.723877 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-2cc9ec19-b5d2-433e-a294-113edfd34cfa tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:19.747779 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2cc9ec19-b5d2-433e-a294-113edfd34cfa tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:19.748599 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2cc9ec19-b5d2-433e-a294-113edfd34cfa tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:19.750068 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2cc9ec19-b5d2-433e-a294-113edfd34cfa tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:19.750888 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2cc9ec19-b5d2-433e-a294-113edfd34cfa tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:20.092075 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2cc9ec19-b5d2-433e-a294-113edfd34cfa tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:20.105321 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-2cc9ec19-b5d2-433e-a294-113edfd34cfa tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1357 microversion: 2.1 time: 0.397886 Feb 04 18:08:20.110885 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 426/850] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:19 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1357 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:20.206588 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-130f032c-2aed-49f7-aaf9-fddc12f00e3a req-d46b1608-4e7a-4488-9e10-0de66b2c247f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "511d5301-1a67-4334-91b8-88220c31cefe", "tag": "83ecd4ba-cf52-4c67-b991-f2331aa88d95"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:08:20.212383 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:08:20.212383 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:08:20.225254 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-130f032c-2aed-49f7-aaf9-fddc12f00e3a req-d46b1608-4e7a-4488-9e10-0de66b2c247f service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:20.226034 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-130f032c-2aed-49f7-aaf9-fddc12f00e3a req-d46b1608-4e7a-4488-9e10-0de66b2c247f service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:20.251183 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-130f032c-2aed-49f7-aaf9-fddc12f00e3a req-d46b1608-4e7a-4488-9e10-0de66b2c247f service nova] Creating event network-changed:83ecd4ba-cf52-4c67-b991-f2331aa88d95 for instance 511d5301-1a67-4334-91b8-88220c31cefe on hv-cinder-82276 Feb 04 18:08:20.259263 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-130f032c-2aed-49f7-aaf9-fddc12f00e3a req-d46b1608-4e7a-4488-9e10-0de66b2c247f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061877 Feb 04 18:08:20.260912 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 425/851] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:08:21.136030 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-faf0a89a-9565-4718-a786-641826a05422 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:21.138090 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-faf0a89a-9565-4718-a786-641826a05422 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:21.154950 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-faf0a89a-9565-4718-a786-641826a05422 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:21.156118 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-faf0a89a-9565-4718-a786-641826a05422 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:21.157763 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-faf0a89a-9565-4718-a786-641826a05422 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:21.158624 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-faf0a89a-9565-4718-a786-641826a05422 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:21.379665 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-faf0a89a-9565-4718-a786-641826a05422 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:21.387734 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-faf0a89a-9565-4718-a786-641826a05422 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1357 microversion: 2.1 time: 0.259305 Feb 04 18:08:21.388324 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 427/852] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:21 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1357 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:22.414251 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b8665599-9d94-48a8-a0e5-1b5124ccd55f tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:22.414901 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-b8665599-9d94-48a8-a0e5-1b5124ccd55f tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:22.423259 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b8665599-9d94-48a8-a0e5-1b5124ccd55f tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:22.423712 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b8665599-9d94-48a8-a0e5-1b5124ccd55f tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:22.424521 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b8665599-9d94-48a8-a0e5-1b5124ccd55f tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:22.424960 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b8665599-9d94-48a8-a0e5-1b5124ccd55f tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:22.567173 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-b8665599-9d94-48a8-a0e5-1b5124ccd55f tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:22.574955 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b8665599-9d94-48a8-a0e5-1b5124ccd55f tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1357 microversion: 2.1 time: 0.165231 Feb 04 18:08:22.575563 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 426/853] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:22 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:08:23.592249 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-3b511b2d-a2f1-40ea-b4e8-388d39dd7002 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:23.592906 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-3b511b2d-a2f1-40ea-b4e8-388d39dd7002 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:23.599455 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3b511b2d-a2f1-40ea-b4e8-388d39dd7002 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:23.599907 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3b511b2d-a2f1-40ea-b4e8-388d39dd7002 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:23.600702 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3b511b2d-a2f1-40ea-b4e8-388d39dd7002 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:23.601248 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3b511b2d-a2f1-40ea-b4e8-388d39dd7002 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:23.735907 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-3b511b2d-a2f1-40ea-b4e8-388d39dd7002 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:23.743456 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-3b511b2d-a2f1-40ea-b4e8-388d39dd7002 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1357 microversion: 2.1 time: 0.155674 Feb 04 18:08:23.744029 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 428/854] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:23 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:24.761435 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-7373557f-26c3-49be-af2d-bd545f0cbb8d tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:24.762038 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-7373557f-26c3-49be-af2d-bd545f0cbb8d tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:24.768751 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7373557f-26c3-49be-af2d-bd545f0cbb8d tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:24.769205 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7373557f-26c3-49be-af2d-bd545f0cbb8d tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:24.770002 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7373557f-26c3-49be-af2d-bd545f0cbb8d tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:24.770472 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7373557f-26c3-49be-af2d-bd545f0cbb8d tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:24.908215 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-7373557f-26c3-49be-af2d-bd545f0cbb8d tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:24.916007 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-7373557f-26c3-49be-af2d-bd545f0cbb8d tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1357 microversion: 2.1 time: 0.158981 Feb 04 18:08:24.916606 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 427/855] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:24 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:25.932730 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-49797b2d-5cb0-4a71-ae3d-47a7e0d43873 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:25.933406 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-49797b2d-5cb0-4a71-ae3d-47a7e0d43873 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:25.939605 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-49797b2d-5cb0-4a71-ae3d-47a7e0d43873 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:25.949640 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-49797b2d-5cb0-4a71-ae3d-47a7e0d43873 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:25.949640 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-49797b2d-5cb0-4a71-ae3d-47a7e0d43873 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:25.949640 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-49797b2d-5cb0-4a71-ae3d-47a7e0d43873 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:26.070289 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-49797b2d-5cb0-4a71-ae3d-47a7e0d43873 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:26.078139 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-49797b2d-5cb0-4a71-ae3d-47a7e0d43873 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1357 microversion: 2.1 time: 0.149144 Feb 04 18:08:26.078740 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 429/856] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:25 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:27.095129 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b2ad9e85-855c-44ff-9d31-a0913c5ccd9e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:27.095729 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-b2ad9e85-855c-44ff-9d31-a0913c5ccd9e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:27.102153 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b2ad9e85-855c-44ff-9d31-a0913c5ccd9e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:27.102682 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b2ad9e85-855c-44ff-9d31-a0913c5ccd9e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:27.103444 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b2ad9e85-855c-44ff-9d31-a0913c5ccd9e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:27.103991 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b2ad9e85-855c-44ff-9d31-a0913c5ccd9e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:27.236109 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-b2ad9e85-855c-44ff-9d31-a0913c5ccd9e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:27.243790 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b2ad9e85-855c-44ff-9d31-a0913c5ccd9e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1357 microversion: 2.1 time: 0.152317 Feb 04 18:08:27.244853 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 428/857] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:27 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:28.261188 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-df091794-d7d3-4079-b4a8-7540086f9b9b tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:28.262036 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-df091794-d7d3-4079-b4a8-7540086f9b9b tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:28.268519 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-df091794-d7d3-4079-b4a8-7540086f9b9b tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:28.268970 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-df091794-d7d3-4079-b4a8-7540086f9b9b tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:28.269751 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-df091794-d7d3-4079-b4a8-7540086f9b9b tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:28.270256 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-df091794-d7d3-4079-b4a8-7540086f9b9b tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:28.414589 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-df091794-d7d3-4079-b4a8-7540086f9b9b tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:28.422855 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-df091794-d7d3-4079-b4a8-7540086f9b9b tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1357 microversion: 2.1 time: 0.165217 Feb 04 18:08:28.431886 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 430/858] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:28 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:08:29.440244 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a49c7664-f51f-4ff0-bb0f-1f09934c6c7c tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:29.440896 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-a49c7664-f51f-4ff0-bb0f-1f09934c6c7c tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:29.448139 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a49c7664-f51f-4ff0-bb0f-1f09934c6c7c tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:29.448584 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a49c7664-f51f-4ff0-bb0f-1f09934c6c7c tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:29.449374 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a49c7664-f51f-4ff0-bb0f-1f09934c6c7c tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:29.449806 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a49c7664-f51f-4ff0-bb0f-1f09934c6c7c tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:29.591570 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-a49c7664-f51f-4ff0-bb0f-1f09934c6c7c tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:29.599549 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a49c7664-f51f-4ff0-bb0f-1f09934c6c7c tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1357 microversion: 2.1 time: 0.162913 Feb 04 18:08:29.600256 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 429/859] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:29 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:08:30.622484 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-db06f3fd-72c3-4283-895a-1874296d7c3d tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:30.623112 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-db06f3fd-72c3-4283-895a-1874296d7c3d tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:30.629716 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-db06f3fd-72c3-4283-895a-1874296d7c3d tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:30.630160 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-db06f3fd-72c3-4283-895a-1874296d7c3d tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:30.631010 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-db06f3fd-72c3-4283-895a-1874296d7c3d tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:30.631419 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-db06f3fd-72c3-4283-895a-1874296d7c3d tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:30.797178 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-db06f3fd-72c3-4283-895a-1874296d7c3d tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:30.805220 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-db06f3fd-72c3-4283-895a-1874296d7c3d tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1357 microversion: 2.1 time: 0.186333 Feb 04 18:08:30.805879 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 431/860] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:30 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:08:31.829050 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-bc7f5502-73f1-4676-a1a0-7f27c8e839a2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:31.829882 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-bc7f5502-73f1-4676-a1a0-7f27c8e839a2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:31.836450 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bc7f5502-73f1-4676-a1a0-7f27c8e839a2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:31.845341 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bc7f5502-73f1-4676-a1a0-7f27c8e839a2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:31.845341 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bc7f5502-73f1-4676-a1a0-7f27c8e839a2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:31.845341 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bc7f5502-73f1-4676-a1a0-7f27c8e839a2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:32.024179 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-bc7f5502-73f1-4676-a1a0-7f27c8e839a2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:32.033659 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-bc7f5502-73f1-4676-a1a0-7f27c8e839a2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1357 microversion: 2.1 time: 0.208180 Feb 04 18:08:32.034427 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 430/861] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:31 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1357 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:33.054667 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-a288b921-5399-4337-9954-708ec090a0c9 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:33.055870 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-a288b921-5399-4337-9954-708ec090a0c9 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:33.067235 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a288b921-5399-4337-9954-708ec090a0c9 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:33.069954 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a288b921-5399-4337-9954-708ec090a0c9 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:33.069954 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a288b921-5399-4337-9954-708ec090a0c9 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:33.070272 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a288b921-5399-4337-9954-708ec090a0c9 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:33.263974 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-a288b921-5399-4337-9954-708ec090a0c9 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:33.276495 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-a288b921-5399-4337-9954-708ec090a0c9 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1357 microversion: 2.1 time: 0.228533 Feb 04 18:08:33.277394 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 432/862] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:33 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1357 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:34.301611 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-d556220d-7787-4967-86c8-b4eb920317d8 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:34.302219 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-d556220d-7787-4967-86c8-b4eb920317d8 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:34.309423 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d556220d-7787-4967-86c8-b4eb920317d8 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:34.309870 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d556220d-7787-4967-86c8-b4eb920317d8 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:34.310715 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d556220d-7787-4967-86c8-b4eb920317d8 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:34.311172 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d556220d-7787-4967-86c8-b4eb920317d8 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:34.471802 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-d556220d-7787-4967-86c8-b4eb920317d8 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:34.480576 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-d556220d-7787-4967-86c8-b4eb920317d8 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1357 microversion: 2.1 time: 0.182480 Feb 04 18:08:34.481168 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 431/863] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:34 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:35.297542 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-2af349ee-aab5-490c-995b-8fd6f9188775 req-3eb51cce-4fdd-447a-9f5d-8664df8cdd24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "511d5301-1a67-4334-91b8-88220c31cefe", "name": "network-vif-plugged", "status": "completed", "tag": "83ecd4ba-cf52-4c67-b991-f2331aa88d95"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:08:35.299328 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:08:35.299328 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:08:35.307453 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-2af349ee-aab5-490c-995b-8fd6f9188775 req-3eb51cce-4fdd-447a-9f5d-8664df8cdd24 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:35.307787 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-2af349ee-aab5-490c-995b-8fd6f9188775 req-3eb51cce-4fdd-447a-9f5d-8664df8cdd24 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:35.320329 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-2af349ee-aab5-490c-995b-8fd6f9188775 req-3eb51cce-4fdd-447a-9f5d-8664df8cdd24 service nova] Creating event network-vif-plugged:83ecd4ba-cf52-4c67-b991-f2331aa88d95 for instance 511d5301-1a67-4334-91b8-88220c31cefe on hv-cinder-82276 Feb 04 18:08:35.326378 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-2af349ee-aab5-490c-995b-8fd6f9188775 req-3eb51cce-4fdd-447a-9f5d-8664df8cdd24 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032639 Feb 04 18:08:35.327024 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 433/864] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:08:35.497858 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-ef277230-98b4-4f9a-b629-af7d0bb63506 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:35.498584 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-ef277230-98b4-4f9a-b629-af7d0bb63506 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:35.505464 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ef277230-98b4-4f9a-b629-af7d0bb63506 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:35.505911 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ef277230-98b4-4f9a-b629-af7d0bb63506 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:35.506739 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ef277230-98b4-4f9a-b629-af7d0bb63506 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:35.507193 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ef277230-98b4-4f9a-b629-af7d0bb63506 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:35.676011 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ef277230-98b4-4f9a-b629-af7d0bb63506 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:35.685680 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-ef277230-98b4-4f9a-b629-af7d0bb63506 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1357 microversion: 2.1 time: 0.192218 Feb 04 18:08:35.686285 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 432/865] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:35 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:36.705475 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-7cabf2ab-4d3d-4ddb-9559-47883231b27c tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:36.706208 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-7cabf2ab-4d3d-4ddb-9559-47883231b27c tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:36.712816 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7cabf2ab-4d3d-4ddb-9559-47883231b27c tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:36.713827 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7cabf2ab-4d3d-4ddb-9559-47883231b27c tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:36.714687 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7cabf2ab-4d3d-4ddb-9559-47883231b27c tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:36.715127 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7cabf2ab-4d3d-4ddb-9559-47883231b27c tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:36.863018 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-7cabf2ab-4d3d-4ddb-9559-47883231b27c tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:36.872169 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-7cabf2ab-4d3d-4ddb-9559-47883231b27c tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1357 microversion: 2.1 time: 0.171071 Feb 04 18:08:36.877165 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 434/866] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:36 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:08:37.890758 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-fb279cee-55cb-4b57-bcdd-8aa75af4b0c7 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:37.891339 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-fb279cee-55cb-4b57-bcdd-8aa75af4b0c7 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:37.897936 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fb279cee-55cb-4b57-bcdd-8aa75af4b0c7 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:37.898627 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fb279cee-55cb-4b57-bcdd-8aa75af4b0c7 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:37.899426 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fb279cee-55cb-4b57-bcdd-8aa75af4b0c7 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:37.899874 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fb279cee-55cb-4b57-bcdd-8aa75af4b0c7 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:38.081147 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-fb279cee-55cb-4b57-bcdd-8aa75af4b0c7 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:38.089848 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-fb279cee-55cb-4b57-bcdd-8aa75af4b0c7 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1546 microversion: 2.1 time: 0.203411 Feb 04 18:08:38.090472 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 433/867] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:37 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1546 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:08:38.116339 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-c4771282-7ae3-4722-9940-20dda4fc6a38 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:38.117087 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-c4771282-7ae3-4722-9940-20dda4fc6a38 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:38.124280 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c4771282-7ae3-4722-9940-20dda4fc6a38 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:38.124735 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c4771282-7ae3-4722-9940-20dda4fc6a38 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:38.125540 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c4771282-7ae3-4722-9940-20dda4fc6a38 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:38.125983 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c4771282-7ae3-4722-9940-20dda4fc6a38 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:38.273048 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c4771282-7ae3-4722-9940-20dda4fc6a38 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:38.281261 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-c4771282-7ae3-4722-9940-20dda4fc6a38 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1546 microversion: 2.1 time: 0.169093 Feb 04 18:08:38.281928 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 435/868] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:38 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1546 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:38.297942 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-fe80be06-ea79-4ad9-8997-5769ba9419d5 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:38.301574 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:08:38.301574 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:08:38.302774 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-fe80be06-ea79-4ad9-8997-5769ba9419d5 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:38.303556 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-fe80be06-ea79-4ad9-8997-5769ba9419d5 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Searching by: {'deleted': False, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010'} {{(pid=123567) get_all /opt/stack/nova/nova/compute/api.py:2908}} Feb 04 18:08:38.314085 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fe80be06-ea79-4ad9-8997-5769ba9419d5 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:38.315815 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fe80be06-ea79-4ad9-8997-5769ba9419d5 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:38.316056 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fe80be06-ea79-4ad9-8997-5769ba9419d5 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:38.316711 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fe80be06-ea79-4ad9-8997-5769ba9419d5 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:38.469196 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.multi_cell_list [None req-fe80be06-ea79-4ad9-8997-5769ba9419d5 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 04 18:08:38.578617 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-fe80be06-ea79-4ad9-8997-5769ba9419d5 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.284331 Feb 04 18:08:38.579225 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 434/869] 10.222.0.98 () {58 vars in 1124 bytes} [Fri Feb 4 18:08:38 2022] GET /compute/v2.1/servers => generated 342 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:08:38.600278 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-36696b70-1879-4c71-98d2-0aeec4a54bea tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:38.601364 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-36696b70-1879-4c71-98d2-0aeec4a54bea tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:38.611412 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-36696b70-1879-4c71-98d2-0aeec4a54bea tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:38.614005 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-36696b70-1879-4c71-98d2-0aeec4a54bea tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:38.614005 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-36696b70-1879-4c71-98d2-0aeec4a54bea tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:38.614379 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-36696b70-1879-4c71-98d2-0aeec4a54bea tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:38.784932 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-36696b70-1879-4c71-98d2-0aeec4a54bea tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:38.797404 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-36696b70-1879-4c71-98d2-0aeec4a54bea tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1546 microversion: 2.1 time: 0.203477 Feb 04 18:08:38.798479 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 436/870] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:38 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1546 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:41.868457 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c6adef76-e1d9-4ca2-b3a9-713b6160529e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b70392c-a196-4de5-8db8-4617fd7031f5"}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:08:41.869962 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c6adef76-e1d9-4ca2-b3a9-713b6160529e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:41.876485 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c6adef76-e1d9-4ca2-b3a9-713b6160529e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:41.876933 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c6adef76-e1d9-4ca2-b3a9-713b6160529e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:41.877727 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c6adef76-e1d9-4ca2-b3a9-713b6160529e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:41.878165 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c6adef76-e1d9-4ca2-b3a9-713b6160529e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:42.689097 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c6adef76-e1d9-4ca2-b3a9-713b6160529e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "POST /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.824984 Feb 04 18:08:42.689746 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 435/871] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Feb 4 18:08:41 2022] POST /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe/os-volume_attachments => generated 194 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:08:43.583575 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-84e8dc43-d90a-4891-b679-919b006ccb9e tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:08:43.584130 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-84e8dc43-d90a-4891-b679-919b006ccb9e tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:43.591062 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-84e8dc43-d90a-4891-b679-919b006ccb9e tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:43.591518 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-84e8dc43-d90a-4891-b679-919b006ccb9e tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:43.592320 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-84e8dc43-d90a-4891-b679-919b006ccb9e tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:43.592762 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-84e8dc43-d90a-4891-b679-919b006ccb9e tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:43.617737 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.objects.instance [None req-84e8dc43-d90a-4891-b679-919b006ccb9e tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lazy-loading 'flavor' on Instance uuid 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 {{(pid=123566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:08:43.969412 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-84e8dc43-d90a-4891-b679-919b006ccb9e tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "POST /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1/action" status: 202 len: 0 microversion: 2.1 time: 0.682957 Feb 04 18:08:43.970025 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 437/872] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Feb 4 18:08:43 2022] POST /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1/action => generated 0 bytes in 685 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 04 18:08:43.980298 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-f8e89dc8-e41f-425a-90ab-f3f0a0e608b6 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:43.981390 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-f8e89dc8-e41f-425a-90ab-f3f0a0e608b6 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:43.988215 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f8e89dc8-e41f-425a-90ab-f3f0a0e608b6 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:43.992676 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f8e89dc8-e41f-425a-90ab-f3f0a0e608b6 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:43.992676 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f8e89dc8-e41f-425a-90ab-f3f0a0e608b6 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:43.992676 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f8e89dc8-e41f-425a-90ab-f3f0a0e608b6 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:44.161047 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-f8e89dc8-e41f-425a-90ab-f3f0a0e608b6 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:44.168966 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-f8e89dc8-e41f-425a-90ab-f3f0a0e608b6 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1568 microversion: 2.1 time: 0.193769 Feb 04 18:08:44.169555 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 436/873] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:43 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:45.187695 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-465791c0-11d1-4254-beb2-5cad1b818336 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:45.188415 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-465791c0-11d1-4254-beb2-5cad1b818336 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:45.195328 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-465791c0-11d1-4254-beb2-5cad1b818336 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:45.195788 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-465791c0-11d1-4254-beb2-5cad1b818336 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:45.196624 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-465791c0-11d1-4254-beb2-5cad1b818336 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:45.197074 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-465791c0-11d1-4254-beb2-5cad1b818336 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:45.369759 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-465791c0-11d1-4254-beb2-5cad1b818336 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:45.379449 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-465791c0-11d1-4254-beb2-5cad1b818336 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1568 microversion: 2.1 time: 0.196570 Feb 04 18:08:45.380231 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 438/874] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:45 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:46.396980 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-53d17275-1c46-42f8-bdcc-0dca3127edc5 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:46.397634 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-53d17275-1c46-42f8-bdcc-0dca3127edc5 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:46.404371 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-53d17275-1c46-42f8-bdcc-0dca3127edc5 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:46.404826 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-53d17275-1c46-42f8-bdcc-0dca3127edc5 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:46.410280 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-53d17275-1c46-42f8-bdcc-0dca3127edc5 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:46.410280 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-53d17275-1c46-42f8-bdcc-0dca3127edc5 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:46.582885 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-53d17275-1c46-42f8-bdcc-0dca3127edc5 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:46.591172 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-53d17275-1c46-42f8-bdcc-0dca3127edc5 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1568 microversion: 2.1 time: 0.197864 Feb 04 18:08:46.591757 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 437/875] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:46 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:46.955520 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-66f2c31c-cc2d-4434-8f0b-1e2816d37b03 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:46.956208 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-66f2c31c-cc2d-4434-8f0b-1e2816d37b03 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:46.963823 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-66f2c31c-cc2d-4434-8f0b-1e2816d37b03 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:46.964286 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-66f2c31c-cc2d-4434-8f0b-1e2816d37b03 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:46.965084 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-66f2c31c-cc2d-4434-8f0b-1e2816d37b03 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:46.965525 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-66f2c31c-cc2d-4434-8f0b-1e2816d37b03 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:46.995926 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-66f2c31c-cc2d-4434-8f0b-1e2816d37b03 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5/os-volume_attachments/18947767-c63f-4d94-a622-44b26024c4e0" status: 200 len: 194 microversion: 2.20 time: 0.045372 Feb 04 18:08:46.996568 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 439/876] 10.222.0.98 () {60 vars in 1453 bytes} [Fri Feb 4 18:08:46 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5/os-volume_attachments/18947767-c63f-4d94-a622-44b26024c4e0 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 04 18:08:47.059270 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c96ce254-96ca-4dbc-aa6e-3748cbc96af8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:47.059750 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c96ce254-96ca-4dbc-aa6e-3748cbc96af8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:47.065765 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c96ce254-96ca-4dbc-aa6e-3748cbc96af8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:47.066215 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c96ce254-96ca-4dbc-aa6e-3748cbc96af8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:47.069823 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c96ce254-96ca-4dbc-aa6e-3748cbc96af8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:47.069823 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c96ce254-96ca-4dbc-aa6e-3748cbc96af8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:47.151926 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.objects.instance [None req-c96ce254-96ca-4dbc-aa6e-3748cbc96af8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lazy-loading 'services' on Instance uuid 514ca883-72d2-4695-a4b6-47c18ce4add5 {{(pid=123567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:08:47.380710 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c96ce254-96ca-4dbc-aa6e-3748cbc96af8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "DELETE /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5/os-volume_attachments/18947767-c63f-4d94-a622-44b26024c4e0" status: 202 len: 0 microversion: 2.20 time: 0.325047 Feb 04 18:08:47.381316 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 438/877] 10.222.0.98 () {60 vars in 1456 bytes} [Fri Feb 4 18:08:47 2022] DELETE /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5/os-volume_attachments/18947767-c63f-4d94-a622-44b26024c4e0 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 04 18:08:47.390155 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-6f2f8786-5d47-4529-9c90-041cd2d1ddba tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:47.391169 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-6f2f8786-5d47-4529-9c90-041cd2d1ddba tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:47.397415 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6f2f8786-5d47-4529-9c90-041cd2d1ddba tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:47.397870 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6f2f8786-5d47-4529-9c90-041cd2d1ddba tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:47.398718 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6f2f8786-5d47-4529-9c90-041cd2d1ddba tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:47.399160 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6f2f8786-5d47-4529-9c90-041cd2d1ddba tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:47.429694 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-6f2f8786-5d47-4529-9c90-041cd2d1ddba tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043245 Feb 04 18:08:47.430258 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 440/878] 10.222.0.98 () {60 vars in 1342 bytes} [Fri Feb 4 18:08:47 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 04 18:08:47.609446 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b45fd3d0-435d-435f-80a2-6b4557db3269 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:47.610144 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-b45fd3d0-435d-435f-80a2-6b4557db3269 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:47.617038 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b45fd3d0-435d-435f-80a2-6b4557db3269 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:47.617856 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b45fd3d0-435d-435f-80a2-6b4557db3269 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:47.618270 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b45fd3d0-435d-435f-80a2-6b4557db3269 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:47.618747 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b45fd3d0-435d-435f-80a2-6b4557db3269 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:47.758809 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-b45fd3d0-435d-435f-80a2-6b4557db3269 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:47.768516 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b45fd3d0-435d-435f-80a2-6b4557db3269 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1568 microversion: 2.1 time: 0.162112 Feb 04 18:08:47.769407 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 439/879] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:47 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:48.199495 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-1d6f1a7c-46f5-4fe7-b57d-69846fe8260a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf4e173b-28f9-45de-9e75-0b48de5ac590"}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:08:48.200590 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-1d6f1a7c-46f5-4fe7-b57d-69846fe8260a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:48.206908 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1d6f1a7c-46f5-4fe7-b57d-69846fe8260a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:48.207359 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1d6f1a7c-46f5-4fe7-b57d-69846fe8260a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:48.208164 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1d6f1a7c-46f5-4fe7-b57d-69846fe8260a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:48.208602 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1d6f1a7c-46f5-4fe7-b57d-69846fe8260a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:48.442346 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e9c257d6-ed2e-4177-8eb0-5184f683e12f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:48.443717 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-e9c257d6-ed2e-4177-8eb0-5184f683e12f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:48.451723 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e9c257d6-ed2e-4177-8eb0-5184f683e12f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:48.452181 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e9c257d6-ed2e-4177-8eb0-5184f683e12f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:48.452994 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e9c257d6-ed2e-4177-8eb0-5184f683e12f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:48.453436 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e9c257d6-ed2e-4177-8eb0-5184f683e12f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:48.487548 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e9c257d6-ed2e-4177-8eb0-5184f683e12f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049648 Feb 04 18:08:48.488152 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 440/880] 10.222.0.98 () {60 vars in 1342 bytes} [Fri Feb 4 18:08:48 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 04 18:08:48.786706 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-eef148ad-db45-4d9b-b5d4-d77a2cbac4a3 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:48.787436 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-eef148ad-db45-4d9b-b5d4-d77a2cbac4a3 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:48.794324 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-eef148ad-db45-4d9b-b5d4-d77a2cbac4a3 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:48.794816 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-eef148ad-db45-4d9b-b5d4-d77a2cbac4a3 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:48.795706 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-eef148ad-db45-4d9b-b5d4-d77a2cbac4a3 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:48.796141 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-eef148ad-db45-4d9b-b5d4-d77a2cbac4a3 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:48.948618 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-eef148ad-db45-4d9b-b5d4-d77a2cbac4a3 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:48.956130 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-eef148ad-db45-4d9b-b5d4-d77a2cbac4a3 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1568 microversion: 2.1 time: 0.173538 Feb 04 18:08:48.956729 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 441/881] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:48 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:08:49.169143 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-1d6f1a7c-46f5-4fe7-b57d-69846fe8260a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "POST /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.974273 Feb 04 18:08:49.169961 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 441/882] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Feb 4 18:08:48 2022] POST /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c/os-volume_attachments => generated 194 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:08:49.500073 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-762b2be2-606e-4bb8-aa8b-90a49fb2a607 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:49.501057 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-762b2be2-606e-4bb8-aa8b-90a49fb2a607 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:49.507531 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-762b2be2-606e-4bb8-aa8b-90a49fb2a607 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:49.507983 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-762b2be2-606e-4bb8-aa8b-90a49fb2a607 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:49.508821 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-762b2be2-606e-4bb8-aa8b-90a49fb2a607 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:49.509260 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-762b2be2-606e-4bb8-aa8b-90a49fb2a607 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:49.543431 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-762b2be2-606e-4bb8-aa8b-90a49fb2a607 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047285 Feb 04 18:08:49.544242 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 442/883] 10.222.0.98 () {60 vars in 1342 bytes} [Fri Feb 4 18:08:49 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 04 18:08:49.981455 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-5d7b68b3-ccc3-4c56-9ccb-7a0bee3964ff tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:49.982782 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-5d7b68b3-ccc3-4c56-9ccb-7a0bee3964ff tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:49.992312 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5d7b68b3-ccc3-4c56-9ccb-7a0bee3964ff tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:49.992771 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5d7b68b3-ccc3-4c56-9ccb-7a0bee3964ff tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:49.993570 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5d7b68b3-ccc3-4c56-9ccb-7a0bee3964ff tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:49.994019 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5d7b68b3-ccc3-4c56-9ccb-7a0bee3964ff tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:50.159662 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-5d7b68b3-ccc3-4c56-9ccb-7a0bee3964ff tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:50.167539 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-5d7b68b3-ccc3-4c56-9ccb-7a0bee3964ff tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1568 microversion: 2.1 time: 0.195452 Feb 04 18:08:50.168427 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 442/884] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:49 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:50.556722 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-ab4edf85-b78e-4906-b89c-8d1f41b9c967 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:50.558310 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-ab4edf85-b78e-4906-b89c-8d1f41b9c967 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:50.569884 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ab4edf85-b78e-4906-b89c-8d1f41b9c967 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:50.570730 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ab4edf85-b78e-4906-b89c-8d1f41b9c967 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:50.572143 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ab4edf85-b78e-4906-b89c-8d1f41b9c967 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:50.572955 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ab4edf85-b78e-4906-b89c-8d1f41b9c967 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:50.605755 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-ab4edf85-b78e-4906-b89c-8d1f41b9c967 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054144 Feb 04 18:08:50.606388 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 443/885] 10.222.0.98 () {60 vars in 1342 bytes} [Fri Feb 4 18:08:50 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 04 18:08:51.193939 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-5523e4f3-e544-47b2-9d6b-f9f30799d145 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:51.195020 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-5523e4f3-e544-47b2-9d6b-f9f30799d145 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:51.202699 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5523e4f3-e544-47b2-9d6b-f9f30799d145 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:51.203148 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5523e4f3-e544-47b2-9d6b-f9f30799d145 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:51.204148 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5523e4f3-e544-47b2-9d6b-f9f30799d145 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:51.204594 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5523e4f3-e544-47b2-9d6b-f9f30799d145 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:51.427501 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-5523e4f3-e544-47b2-9d6b-f9f30799d145 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:51.438987 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-5523e4f3-e544-47b2-9d6b-f9f30799d145 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1568 microversion: 2.1 time: 0.249165 Feb 04 18:08:51.439867 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 443/886] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:51 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:51.489092 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-af16db57-8057-4b47-8f53-893892498a94 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:51.489715 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-af16db57-8057-4b47-8f53-893892498a94 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:51.496849 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-af16db57-8057-4b47-8f53-893892498a94 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:51.501955 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-af16db57-8057-4b47-8f53-893892498a94 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:51.501955 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-af16db57-8057-4b47-8f53-893892498a94 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:51.501955 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-af16db57-8057-4b47-8f53-893892498a94 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:51.622118 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-2e748da4-4785-4915-8498-565c16c2b4d2 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:51.624778 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-2e748da4-4785-4915-8498-565c16c2b4d2 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:51.640374 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2e748da4-4785-4915-8498-565c16c2b4d2 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:51.641171 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2e748da4-4785-4915-8498-565c16c2b4d2 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:51.642879 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2e748da4-4785-4915-8498-565c16c2b4d2 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:51.644018 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2e748da4-4785-4915-8498-565c16c2b4d2 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:51.693148 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-2e748da4-4785-4915-8498-565c16c2b4d2 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079326 Feb 04 18:08:51.694546 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 444/887] 10.222.0.98 () {60 vars in 1342 bytes} [Fri Feb 4 18:08:51 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 04 18:08:51.695898 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-af16db57-8057-4b47-8f53-893892498a94 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:51.707102 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-af16db57-8057-4b47-8f53-893892498a94 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1592 microversion: 2.1 time: 0.221552 Feb 04 18:08:51.707796 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 444/888] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:51 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1592 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:08:52.458687 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-3dd8b7a6-fdd6-4422-9c84-6657a4de23cc tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:52.459503 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-3dd8b7a6-fdd6-4422-9c84-6657a4de23cc tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:52.470832 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3dd8b7a6-fdd6-4422-9c84-6657a4de23cc tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:52.470832 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3dd8b7a6-fdd6-4422-9c84-6657a4de23cc tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:52.471442 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3dd8b7a6-fdd6-4422-9c84-6657a4de23cc tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:52.471763 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3dd8b7a6-fdd6-4422-9c84-6657a4de23cc tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:52.652603 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-3dd8b7a6-fdd6-4422-9c84-6657a4de23cc tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:52.666664 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-3dd8b7a6-fdd6-4422-9c84-6657a4de23cc tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1568 microversion: 2.1 time: 0.213089 Feb 04 18:08:52.668006 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 445/889] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:52 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:52.713196 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-644fd232-7d34-44d7-9f09-b69d4c774830 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:52.715062 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-644fd232-7d34-44d7-9f09-b69d4c774830 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:52.723570 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-644fd232-7d34-44d7-9f09-b69d4c774830 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:52.724207 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-644fd232-7d34-44d7-9f09-b69d4c774830 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:52.725439 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-644fd232-7d34-44d7-9f09-b69d4c774830 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:52.725959 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-644fd232-7d34-44d7-9f09-b69d4c774830 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:52.773006 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-644fd232-7d34-44d7-9f09-b69d4c774830 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.067169 Feb 04 18:08:52.773987 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 445/890] 10.222.0.98 () {60 vars in 1342 bytes} [Fri Feb 4 18:08:52 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:08:52.852888 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-0ff63f0a-d5fc-4383-a205-e25010b35cb9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:52.854648 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-0ff63f0a-d5fc-4383-a205-e25010b35cb9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:52.862957 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0ff63f0a-d5fc-4383-a205-e25010b35cb9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:52.863745 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0ff63f0a-d5fc-4383-a205-e25010b35cb9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:52.865355 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0ff63f0a-d5fc-4383-a205-e25010b35cb9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:52.865911 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0ff63f0a-d5fc-4383-a205-e25010b35cb9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:52.897411 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-0ff63f0a-d5fc-4383-a205-e25010b35cb9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Going to try to terminate instance {{(pid=123566) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 04 18:08:53.244860 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-0ff63f0a-d5fc-4383-a205-e25010b35cb9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "DELETE /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 204 len: 0 microversion: 2.20 time: 0.395155 Feb 04 18:08:53.245477 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 446/891] 10.222.0.98 () {60 vars in 1279 bytes} [Fri Feb 4 18:08:52 2022] DELETE /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 04 18:08:53.253927 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-ed7c4f58-dd89-45b2-a560-e529223d2a96 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:53.254588 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-ed7c4f58-dd89-45b2-a560-e529223d2a96 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:53.260922 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ed7c4f58-dd89-45b2-a560-e529223d2a96 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:53.261407 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ed7c4f58-dd89-45b2-a560-e529223d2a96 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:53.262194 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ed7c4f58-dd89-45b2-a560-e529223d2a96 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:53.262661 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ed7c4f58-dd89-45b2-a560-e529223d2a96 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:53.524883 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ed7c4f58-dd89-45b2-a560-e529223d2a96 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:53.536770 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ed7c4f58-dd89-45b2-a560-e529223d2a96 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:53.539305 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ed7c4f58-dd89-45b2-a560-e529223d2a96 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:53.540792 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-ed7c4f58-dd89-45b2-a560-e529223d2a96 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1721 microversion: 2.20 time: 0.290613 Feb 04 18:08:53.541665 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 446/892] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:08:53 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1721 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:08:53.697438 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-be44a80d-72c3-4036-9a7c-333342ca277a tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:53.698683 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-be44a80d-72c3-4036-9a7c-333342ca277a tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:53.709209 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-be44a80d-72c3-4036-9a7c-333342ca277a tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:53.709974 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-be44a80d-72c3-4036-9a7c-333342ca277a tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:53.711338 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-be44a80d-72c3-4036-9a7c-333342ca277a tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:53.712082 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-be44a80d-72c3-4036-9a7c-333342ca277a tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:53.988566 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-be44a80d-72c3-4036-9a7c-333342ca277a tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:53.999032 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-be44a80d-72c3-4036-9a7c-333342ca277a tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1568 microversion: 2.1 time: 0.308791 Feb 04 18:08:53.999931 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 447/893] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:53 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1568 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:54.576512 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c4b398c2-f4ba-4d2b-9758-c3c8b967a466 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:54.577599 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c4b398c2-f4ba-4d2b-9758-c3c8b967a466 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:54.586108 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c4b398c2-f4ba-4d2b-9758-c3c8b967a466 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:54.586886 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c4b398c2-f4ba-4d2b-9758-c3c8b967a466 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:54.588890 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c4b398c2-f4ba-4d2b-9758-c3c8b967a466 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:54.589673 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c4b398c2-f4ba-4d2b-9758-c3c8b967a466 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:54.769760 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-f1d4ff4b-2a81-40a3-88f1-6de36d6fd3c8 req-483e9527-ce4a-4b72-bdd2-777fe942f2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "511d5301-1a67-4334-91b8-88220c31cefe", "tag": "83ecd4ba-cf52-4c67-b991-f2331aa88d95"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:08:54.772695 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:08:54.772695 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:08:54.788560 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-f1d4ff4b-2a81-40a3-88f1-6de36d6fd3c8 req-483e9527-ce4a-4b72-bdd2-777fe942f2c1 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:54.789378 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-f1d4ff4b-2a81-40a3-88f1-6de36d6fd3c8 req-483e9527-ce4a-4b72-bdd2-777fe942f2c1 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:54.811015 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c4b398c2-f4ba-4d2b-9758-c3c8b967a466 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:54.823806 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-f1d4ff4b-2a81-40a3-88f1-6de36d6fd3c8 req-483e9527-ce4a-4b72-bdd2-777fe942f2c1 service nova] Creating event network-changed:83ecd4ba-cf52-4c67-b991-f2331aa88d95 for instance 511d5301-1a67-4334-91b8-88220c31cefe on hv-cinder-82276 Feb 04 18:08:54.829304 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c4b398c2-f4ba-4d2b-9758-c3c8b967a466 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:54.832935 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-f1d4ff4b-2a81-40a3-88f1-6de36d6fd3c8 req-483e9527-ce4a-4b72-bdd2-777fe942f2c1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196911 Feb 04 18:08:54.832935 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 448/894] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:08:54.836739 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c4b398c2-f4ba-4d2b-9758-c3c8b967a466 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:54.839246 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c4b398c2-f4ba-4d2b-9758-c3c8b967a466 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1721 microversion: 2.20 time: 0.272592 Feb 04 18:08:54.842749 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 447/895] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:08:54 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1721 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:08:55.025934 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-9cb6c22e-f8f0-4761-9dd5-3b9a979d7e2c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:55.027107 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-9cb6c22e-f8f0-4761-9dd5-3b9a979d7e2c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:55.034938 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9cb6c22e-f8f0-4761-9dd5-3b9a979d7e2c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:55.062102 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9cb6c22e-f8f0-4761-9dd5-3b9a979d7e2c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:55.062102 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9cb6c22e-f8f0-4761-9dd5-3b9a979d7e2c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:55.062102 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9cb6c22e-f8f0-4761-9dd5-3b9a979d7e2c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:55.247039 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-9cb6c22e-f8f0-4761-9dd5-3b9a979d7e2c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:55.256621 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-9cb6c22e-f8f0-4761-9dd5-3b9a979d7e2c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1568 microversion: 2.1 time: 0.235537 Feb 04 18:08:55.267743 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 449/896] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:55 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:55.866273 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-16a371c5-9e9d-4549-8b39-0378342978b6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:55.867673 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-16a371c5-9e9d-4549-8b39-0378342978b6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:55.884858 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-16a371c5-9e9d-4549-8b39-0378342978b6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:55.885601 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-16a371c5-9e9d-4549-8b39-0378342978b6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:55.886314 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-16a371c5-9e9d-4549-8b39-0378342978b6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:55.886793 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-16a371c5-9e9d-4549-8b39-0378342978b6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:56.056008 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-16a371c5-9e9d-4549-8b39-0378342978b6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:56.080047 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-16a371c5-9e9d-4549-8b39-0378342978b6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:56.082093 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-16a371c5-9e9d-4549-8b39-0378342978b6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:56.083450 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-16a371c5-9e9d-4549-8b39-0378342978b6 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1721 microversion: 2.20 time: 0.222909 Feb 04 18:08:56.084049 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 448/897] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:08:55 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:08:56.274665 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-aa2f4e12-56e3-4a0d-a9d7-25d41880e424 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:56.275941 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-aa2f4e12-56e3-4a0d-a9d7-25d41880e424 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:56.282748 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-aa2f4e12-56e3-4a0d-a9d7-25d41880e424 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:56.283222 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-aa2f4e12-56e3-4a0d-a9d7-25d41880e424 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:56.284015 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-aa2f4e12-56e3-4a0d-a9d7-25d41880e424 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:56.284449 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-aa2f4e12-56e3-4a0d-a9d7-25d41880e424 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:56.474640 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-aa2f4e12-56e3-4a0d-a9d7-25d41880e424 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:56.493734 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-aa2f4e12-56e3-4a0d-a9d7-25d41880e424 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1568 microversion: 2.1 time: 0.221839 Feb 04 18:08:56.494759 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 450/898] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:56 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:57.105537 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3f27fc14-69f8-4df4-bcf4-88d37e013b0c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:57.106258 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-3f27fc14-69f8-4df4-bcf4-88d37e013b0c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:57.113727 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3f27fc14-69f8-4df4-bcf4-88d37e013b0c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:57.114177 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3f27fc14-69f8-4df4-bcf4-88d37e013b0c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:57.115278 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3f27fc14-69f8-4df4-bcf4-88d37e013b0c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:57.115730 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3f27fc14-69f8-4df4-bcf4-88d37e013b0c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:57.215882 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-3f27fc14-69f8-4df4-bcf4-88d37e013b0c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:57.238465 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-3f27fc14-69f8-4df4-bcf4-88d37e013b0c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:57.241922 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-3f27fc14-69f8-4df4-bcf4-88d37e013b0c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:57.253947 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-3f27fc14-69f8-4df4-bcf4-88d37e013b0c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1654 microversion: 2.20 time: 0.147266 Feb 04 18:08:57.253947 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 449/899] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:08:57 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1654 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:08:57.265828 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-a28b475d-939b-45ed-aa12-81fdcd941fcc req-daea4055-aa52-421c-952a-73873256b603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514ca883-72d2-4695-a4b6-47c18ce4add5", "name": "network-vif-deleted", "tag": "fe3cfe16-c9c7-4dcd-a6bf-b32b9ba77df0"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:08:57.267392 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:08:57.267392 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:08:57.275005 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-a28b475d-939b-45ed-aa12-81fdcd941fcc req-daea4055-aa52-421c-952a-73873256b603 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:57.276208 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-a28b475d-939b-45ed-aa12-81fdcd941fcc req-daea4055-aa52-421c-952a-73873256b603 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:57.449818 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-a28b475d-939b-45ed-aa12-81fdcd941fcc req-daea4055-aa52-421c-952a-73873256b603 service nova] Creating event network-vif-deleted:fe3cfe16-c9c7-4dcd-a6bf-b32b9ba77df0 for instance 514ca883-72d2-4695-a4b6-47c18ce4add5 on hv-cinder-82276 Feb 04 18:08:57.455123 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-a28b475d-939b-45ed-aa12-81fdcd941fcc req-daea4055-aa52-421c-952a-73873256b603 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192840 Feb 04 18:08:57.456136 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 451/900] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:08:57.515525 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-ccaf5991-8f3a-49c7-9544-b233217d44d8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:57.516150 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-ccaf5991-8f3a-49c7-9544-b233217d44d8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:57.522246 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ccaf5991-8f3a-49c7-9544-b233217d44d8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:57.522733 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ccaf5991-8f3a-49c7-9544-b233217d44d8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:57.523748 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ccaf5991-8f3a-49c7-9544-b233217d44d8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:57.524141 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ccaf5991-8f3a-49c7-9544-b233217d44d8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:57.762731 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ccaf5991-8f3a-49c7-9544-b233217d44d8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:57.772946 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-ccaf5991-8f3a-49c7-9544-b233217d44d8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1568 microversion: 2.1 time: 0.260999 Feb 04 18:08:57.774101 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 450/901] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:57 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1568 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:08:58.272558 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-76573afc-f659-4c07-8001-dfbb3c0b3c0a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:58.273657 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-76573afc-f659-4c07-8001-dfbb3c0b3c0a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:58.285346 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-76573afc-f659-4c07-8001-dfbb3c0b3c0a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:58.286123 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-76573afc-f659-4c07-8001-dfbb3c0b3c0a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:58.287828 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-76573afc-f659-4c07-8001-dfbb3c0b3c0a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:58.288641 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-76573afc-f659-4c07-8001-dfbb3c0b3c0a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:58.345086 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-76573afc-f659-4c07-8001-dfbb3c0b3c0a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:58.345739 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-76573afc-f659-4c07-8001-dfbb3c0b3c0a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:58.346877 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.objects.instance [None req-76573afc-f659-4c07-8001-dfbb3c0b3c0a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lazy-loading 'fault' on Instance uuid 514ca883-72d2-4695-a4b6-47c18ce4add5 {{(pid=123566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:08:58.412009 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-76573afc-f659-4c07-8001-dfbb3c0b3c0a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:58.433685 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-76573afc-f659-4c07-8001-dfbb3c0b3c0a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:58.435244 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-76573afc-f659-4c07-8001-dfbb3c0b3c0a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:58.436579 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-76573afc-f659-4c07-8001-dfbb3c0b3c0a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 200 len: 1372 microversion: 2.20 time: 0.172685 Feb 04 18:08:58.438489 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 452/902] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:08:58 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:08:58.691783 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e2cfaae3-9bf4-4567-993d-7261e31c7865 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-75408714"}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:08:58.693052 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-e2cfaae3-9bf4-4567-993d-7261e31c7865 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:58.701070 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e2cfaae3-9bf4-4567-993d-7261e31c7865 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:58.701895 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e2cfaae3-9bf4-4567-993d-7261e31c7865 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:58.702938 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e2cfaae3-9bf4-4567-993d-7261e31c7865 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:58.703602 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e2cfaae3-9bf4-4567-993d-7261e31c7865 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:58.801409 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-1101f6f4-7f90-423b-9b3e-9d3073b7ef48 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:58.807234 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-1101f6f4-7f90-423b-9b3e-9d3073b7ef48 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:58.818212 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1101f6f4-7f90-423b-9b3e-9d3073b7ef48 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:58.820263 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1101f6f4-7f90-423b-9b3e-9d3073b7ef48 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:58.821895 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1101f6f4-7f90-423b-9b3e-9d3073b7ef48 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:58.823608 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1101f6f4-7f90-423b-9b3e-9d3073b7ef48 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:58.869864 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.network.security_group_api [None req-e2cfaae3-9bf4-4567-993d-7261e31c7865 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Adding security group bb487184-379f-4c12-a675-be51fef87f1e to port 83ecd4ba-cf52-4c67-b991-f2331aa88d95 Feb 04 18:08:59.344666 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-1101f6f4-7f90-423b-9b3e-9d3073b7ef48 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:08:59.361433 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-1101f6f4-7f90-423b-9b3e-9d3073b7ef48 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1568 microversion: 2.1 time: 0.571965 Feb 04 18:08:59.378612 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 453/903] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:58 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1568 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:08:59.462390 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-0ffb9662-ccdf-4f49-a9be-6ac61a7ff249 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:59.472279 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-0ffb9662-ccdf-4f49-a9be-6ac61a7ff249 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:59.517276 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0ffb9662-ccdf-4f49-a9be-6ac61a7ff249 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:59.521030 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0ffb9662-ccdf-4f49-a9be-6ac61a7ff249 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:59.528540 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0ffb9662-ccdf-4f49-a9be-6ac61a7ff249 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:59.532411 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0ffb9662-ccdf-4f49-a9be-6ac61a7ff249 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:59.561537 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-0ffb9662-ccdf-4f49-a9be-6ac61a7ff249 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] HTTP exception thrown: Instance 514ca883-72d2-4695-a4b6-47c18ce4add5 could not be found. Feb 04 18:08:59.562956 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-0ffb9662-ccdf-4f49-a9be-6ac61a7ff249 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Returning 404 to user: Instance 514ca883-72d2-4695-a4b6-47c18ce4add5 could not be found. {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:08:59.564631 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-0ffb9662-ccdf-4f49-a9be-6ac61a7ff249 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 404 len: 111 microversion: 2.20 time: 0.111934 Feb 04 18:08:59.566160 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 454/904] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:08:59 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 04 18:08:59.579021 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-074bf3b8-b5ea-4218-a9af-330a1bb05647 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '.version_select at 0x7fe8bff10d30>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:59.740535 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e2cfaae3-9bf4-4567-993d-7261e31c7865 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "POST /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe/action" status: 202 len: 0 microversion: 2.1 time: 1.050228 Feb 04 18:08:59.742965 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 451/905] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Feb 4 18:08:58 2022] POST /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe/action => generated 0 bytes in 1056 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 04 18:08:59.764235 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-ebc8be8e-3281-47e9-b27b-df6de30e4e7f req-80f9facd-5dba-49a0-8e85-004a8ca3261a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "511d5301-1a67-4334-91b8-88220c31cefe", "tag": "83ecd4ba-cf52-4c67-b991-f2331aa88d95"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:08:59.769066 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:08:59.769066 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:08:59.784770 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-074bf3b8-b5ea-4218-a9af-330a1bb05647 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2139143506" status: 204 len: 0 microversion: 2.20 time: 0.212664 Feb 04 18:08:59.786871 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 455/906] 10.222.0.98 () {60 vars in 1261 bytes} [Fri Feb 4 18:08:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2139143506 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 04 18:08:59.791335 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-ebc8be8e-3281-47e9-b27b-df6de30e4e7f req-80f9facd-5dba-49a0-8e85-004a8ca3261a service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:59.792320 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-ebc8be8e-3281-47e9-b27b-df6de30e4e7f req-80f9facd-5dba-49a0-8e85-004a8ca3261a service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:59.804962 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-bd6bad68-5c10-4ab2-a187-811608aae9cc tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:08:59.807330 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-bd6bad68-5c10-4ab2-a187-811608aae9cc tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:08:59.832523 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bd6bad68-5c10-4ab2-a187-811608aae9cc tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:59.836439 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bd6bad68-5c10-4ab2-a187-811608aae9cc tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:59.839030 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bd6bad68-5c10-4ab2-a187-811608aae9cc tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:08:59.839856 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bd6bad68-5c10-4ab2-a187-811608aae9cc tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:08:59.851610 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-ebc8be8e-3281-47e9-b27b-df6de30e4e7f req-80f9facd-5dba-49a0-8e85-004a8ca3261a service nova] Creating event network-changed:83ecd4ba-cf52-4c67-b991-f2331aa88d95 for instance 511d5301-1a67-4334-91b8-88220c31cefe on hv-cinder-82276 Feb 04 18:08:59.877830 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-ebc8be8e-3281-47e9-b27b-df6de30e4e7f req-80f9facd-5dba-49a0-8e85-004a8ca3261a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131777 Feb 04 18:08:59.880365 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 452/907] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:09:00.303067 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c8147bc9-eda3-4c04-a62c-5d93d8fd0715 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:09:00.314194 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-bd6bad68-5c10-4ab2-a187-811608aae9cc tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:00.329961 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c8147bc9-eda3-4c04-a62c-5d93d8fd0715 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:00.330962 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-bd6bad68-5c10-4ab2-a187-811608aae9cc tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1756 microversion: 2.1 time: 0.542669 Feb 04 18:09:00.331401 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c8147bc9-eda3-4c04-a62c-5d93d8fd0715 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:00.332578 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 456/908] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:08:59 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1756 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:00.392283 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-7e268ab1-65ef-4156-a925-2383d4ce6896 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:00.394894 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-7e268ab1-65ef-4156-a925-2383d4ce6896 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:00.433208 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7e268ab1-65ef-4156-a925-2383d4ce6896 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:00.434019 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7e268ab1-65ef-4156-a925-2383d4ce6896 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:00.444872 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7e268ab1-65ef-4156-a925-2383d4ce6896 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:00.446019 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7e268ab1-65ef-4156-a925-2383d4ce6896 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:00.917710 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c8147bc9-eda3-4c04-a62c-5d93d8fd0715 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Going to try to stop instance {{(pid=123567) force_stop /opt/stack/nova/nova/compute/api.py:2655}} Feb 04 18:09:01.139986 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-7e268ab1-65ef-4156-a925-2383d4ce6896 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:01.157460 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-7e268ab1-65ef-4156-a925-2383d4ce6896 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1568 microversion: 2.1 time: 0.773355 Feb 04 18:09:01.171023 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 457/909] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:00 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1568 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:09:01.241811 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c8147bc9-eda3-4c04-a62c-5d93d8fd0715 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "POST /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c/action" status: 202 len: 0 microversion: 2.1 time: 0.947799 Feb 04 18:09:01.243785 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 453/910] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Feb 4 18:09:00 2022] POST /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c/action => generated 0 bytes in 957 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 04 18:09:01.263464 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ebc90ebb-17fc-4e74-a516-0a286bf911df tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:01.263840 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ebc90ebb-17fc-4e74-a516-0a286bf911df tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:01.286834 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ebc90ebb-17fc-4e74-a516-0a286bf911df tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:01.288651 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ebc90ebb-17fc-4e74-a516-0a286bf911df tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:01.300126 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ebc90ebb-17fc-4e74-a516-0a286bf911df tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:01.300126 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ebc90ebb-17fc-4e74-a516-0a286bf911df tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:01.595840 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-ebc90ebb-17fc-4e74-a516-0a286bf911df tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:01.611759 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ebc90ebb-17fc-4e74-a516-0a286bf911df tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1723 microversion: 2.1 time: 0.359098 Feb 04 18:09:01.612942 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 458/911] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:01 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1723 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:01.848209 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b494b9f3-5d16-4cc0-94b9-bbcf3e966106 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Action: 'create', calling method: .version_select at 0x7fe8d0af9430>, body: {"keypair": {"name": "tempest-keypair-580612381"}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:09:01.875911 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-b494b9f3-5d16-4cc0-94b9-bbcf3e966106 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Getting quotas for project 745beddd0c154d82a7e95298706587b1. Resources: {'key_pairs'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:09:01.884664 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-b494b9f3-5d16-4cc0-94b9-bbcf3e966106 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Getting quotas for user 74e23ced236b429c8aab135f45fe3e01 and project 745beddd0c154d82a7e95298706587b1. Resources: {'key_pairs'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:09:02.185630 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-7b24a63e-3578-4685-84c0-3f2e7df7db33 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:02.186291 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-7b24a63e-3578-4685-84c0-3f2e7df7db33 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:02.193528 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7b24a63e-3578-4685-84c0-3f2e7df7db33 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:02.193999 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7b24a63e-3578-4685-84c0-3f2e7df7db33 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:02.194859 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7b24a63e-3578-4685-84c0-3f2e7df7db33 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:02.195305 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7b24a63e-3578-4685-84c0-3f2e7df7db33 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:02.224155 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-b494b9f3-5d16-4cc0-94b9-bbcf3e966106 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Getting quotas for project 745beddd0c154d82a7e95298706587b1. Resources: {'key_pairs'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:09:02.228989 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-b494b9f3-5d16-4cc0-94b9-bbcf3e966106 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Getting quotas for user 74e23ced236b429c8aab135f45fe3e01 and project 745beddd0c154d82a7e95298706587b1. Resources: {'key_pairs'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:09:02.256397 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b494b9f3-5d16-4cc0-94b9-bbcf3e966106 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.415407 Feb 04 18:09:02.257550 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 454/912] 10.222.0.98 () {62 vars in 1198 bytes} [Fri Feb 4 18:09:01 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 418 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 04 18:09:02.415964 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-7b24a63e-3578-4685-84c0-3f2e7df7db33 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:02.429152 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-7b24a63e-3578-4685-84c0-3f2e7df7db33 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1568 microversion: 2.1 time: 0.247575 Feb 04 18:09:02.430636 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 459/913] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:02 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1568 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:09:02.631525 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-5b5b86e1-6380-4959-941c-b15721b0503c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:02.632262 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-5b5b86e1-6380-4959-941c-b15721b0503c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:02.639437 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5b5b86e1-6380-4959-941c-b15721b0503c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:02.639895 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5b5b86e1-6380-4959-941c-b15721b0503c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:02.640712 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5b5b86e1-6380-4959-941c-b15721b0503c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:02.641155 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5b5b86e1-6380-4959-941c-b15721b0503c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:02.798597 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5b5b86e1-6380-4959-941c-b15721b0503c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:02.813744 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-5b5b86e1-6380-4959-941c-b15721b0503c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1723 microversion: 2.1 time: 0.185560 Feb 04 18:09:02.814617 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 455/914] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:02 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:09:03.446873 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-fb880c14-a7af-427d-b068-c8f418a4e745 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:03.448300 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-fb880c14-a7af-427d-b068-c8f418a4e745 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:03.454812 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fb880c14-a7af-427d-b068-c8f418a4e745 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:03.460192 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fb880c14-a7af-427d-b068-c8f418a4e745 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:03.460192 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fb880c14-a7af-427d-b068-c8f418a4e745 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:03.460192 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fb880c14-a7af-427d-b068-c8f418a4e745 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:03.643411 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-fb880c14-a7af-427d-b068-c8f418a4e745 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:03.655461 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-fb880c14-a7af-427d-b068-c8f418a4e745 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1568 microversion: 2.1 time: 0.212296 Feb 04 18:09:03.656791 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 460/915] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:03 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1568 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:03.837990 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-15c8bbf8-1c73-468c-8f38-c085d4f6f891 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:03.839157 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-15c8bbf8-1c73-468c-8f38-c085d4f6f891 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:03.851099 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-15c8bbf8-1c73-468c-8f38-c085d4f6f891 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:03.851912 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-15c8bbf8-1c73-468c-8f38-c085d4f6f891 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:03.853465 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-15c8bbf8-1c73-468c-8f38-c085d4f6f891 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:03.854216 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-15c8bbf8-1c73-468c-8f38-c085d4f6f891 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:04.077905 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-15c8bbf8-1c73-468c-8f38-c085d4f6f891 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:04.086381 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-15c8bbf8-1c73-468c-8f38-c085d4f6f891 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1723 microversion: 2.1 time: 0.255601 Feb 04 18:09:04.087100 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 456/916] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:03 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:04.676200 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-96b49a6f-37e0-42b8-8e7f-9a6ef861ea9c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:04.677103 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-96b49a6f-37e0-42b8-8e7f-9a6ef861ea9c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:04.684997 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-96b49a6f-37e0-42b8-8e7f-9a6ef861ea9c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:04.685619 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-96b49a6f-37e0-42b8-8e7f-9a6ef861ea9c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:04.686928 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-96b49a6f-37e0-42b8-8e7f-9a6ef861ea9c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:04.687459 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-96b49a6f-37e0-42b8-8e7f-9a6ef861ea9c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:04.872717 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-96b49a6f-37e0-42b8-8e7f-9a6ef861ea9c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:04.882125 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-96b49a6f-37e0-42b8-8e7f-9a6ef861ea9c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1568 microversion: 2.1 time: 0.210190 Feb 04 18:09:04.883079 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 461/917] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:04 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:09:04.954877 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-10e4f7d1-2aeb-489d-813f-0102e18ed644 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2060563063", "imageRef": "b0fb57f5-967d-4692-94f3-accee37910c3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0bab5cdf-34a8-435a-8e36-431b0f11e511"}], "security_groups": [{"name": "tempest-securitygroup--22729496"}], "key_name": "tempest-keypair-580612381", "user_data": "}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:09:05.067012 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.network.neutron [None req-10e4f7d1-2aeb-489d-813f-0102e18ed644 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] validate_networks() for [('0bab5cdf-34a8-435a-8e36-431b0f11e511', None, None, None, None, None)] {{(pid=123567) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 04 18:09:05.108951 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-3cf877ac-fcb0-43b8-bf18-404fc8ce84ac tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:05.110368 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-3cf877ac-fcb0-43b8-bf18-404fc8ce84ac tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:05.117329 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3cf877ac-fcb0-43b8-bf18-404fc8ce84ac tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:05.117875 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3cf877ac-fcb0-43b8-bf18-404fc8ce84ac tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:05.119439 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3cf877ac-fcb0-43b8-bf18-404fc8ce84ac tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:05.119956 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3cf877ac-fcb0-43b8-bf18-404fc8ce84ac tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:05.337152 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-3cf877ac-fcb0-43b8-bf18-404fc8ce84ac tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:05.346949 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-3cf877ac-fcb0-43b8-bf18-404fc8ce84ac tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1723 microversion: 2.1 time: 0.245712 Feb 04 18:09:05.347686 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 462/918] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:05 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:09:05.554082 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-10e4f7d1-2aeb-489d-813f-0102e18ed644 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Flavor limits 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 04 18:09:05.554551 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-10e4f7d1-2aeb-489d-813f-0102e18ed644 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Image limits 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 04 18:09:05.555030 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-10e4f7d1-2aeb-489d-813f-0102e18ed644 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Flavor pref 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 04 18:09:05.555450 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-10e4f7d1-2aeb-489d-813f-0102e18ed644 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Image pref 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 04 18:09:05.555867 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-10e4f7d1-2aeb-489d-813f-0102e18ed644 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 04 18:09:05.565133 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-10e4f7d1-2aeb-489d-813f-0102e18ed644 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:05.565582 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-10e4f7d1-2aeb-489d-813f-0102e18ed644 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:05.566400 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-10e4f7d1-2aeb-489d-813f-0102e18ed644 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:05.566873 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-10e4f7d1-2aeb-489d-813f-0102e18ed644 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:05.584325 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-10e4f7d1-2aeb-489d-813f-0102e18ed644 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Getting quotas for project 745beddd0c154d82a7e95298706587b1. Resources: {'cores', 'ram', 'instances'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:09:05.589104 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-10e4f7d1-2aeb-489d-813f-0102e18ed644 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Getting quotas for user 74e23ced236b429c8aab135f45fe3e01 and project 745beddd0c154d82a7e95298706587b1. Resources: {'cores', 'ram', 'instances'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:09:05.600375 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-10e4f7d1-2aeb-489d-813f-0102e18ed644 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Going to run 1 instances... {{(pid=123567) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 04 18:09:05.602864 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-10e4f7d1-2aeb-489d-813f-0102e18ed644 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0fb57f5-967d-4692-94f3-accee37910c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 04 18:09:05.729258 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-10e4f7d1-2aeb-489d-813f-0102e18ed644 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [8c358e2a-d804-4cd7-a529-7dc771b24ffc] AMQP server on 10.222.0.98:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 04 18:09:05.901365 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-bab4639d-7833-4fc2-86db-ef373ef95140 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:05.902048 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-bab4639d-7833-4fc2-86db-ef373ef95140 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:05.909198 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bab4639d-7833-4fc2-86db-ef373ef95140 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:05.909695 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bab4639d-7833-4fc2-86db-ef373ef95140 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:05.910563 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bab4639d-7833-4fc2-86db-ef373ef95140 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:05.911013 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bab4639d-7833-4fc2-86db-ef373ef95140 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:06.066624 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-bab4639d-7833-4fc2-86db-ef373ef95140 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:06.075381 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-bab4639d-7833-4fc2-86db-ef373ef95140 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1568 microversion: 2.1 time: 0.178404 Feb 04 18:09:06.075970 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 463/919] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:05 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:09:06.365493 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-2ed6ca21-c52e-4068-b2b5-4ced16484585 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:06.366111 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-2ed6ca21-c52e-4068-b2b5-4ced16484585 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:06.373215 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2ed6ca21-c52e-4068-b2b5-4ced16484585 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:06.373669 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2ed6ca21-c52e-4068-b2b5-4ced16484585 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:06.374536 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2ed6ca21-c52e-4068-b2b5-4ced16484585 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:06.374986 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2ed6ca21-c52e-4068-b2b5-4ced16484585 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:06.523246 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2ed6ca21-c52e-4068-b2b5-4ced16484585 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:06.531567 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-2ed6ca21-c52e-4068-b2b5-4ced16484585 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1723 microversion: 2.1 time: 0.170107 Feb 04 18:09:06.532221 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 464/920] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:06 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:09:06.738318 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO oslo.messaging._drivers.impl_rabbit [None req-10e4f7d1-2aeb-489d-813f-0102e18ed644 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [8c358e2a-d804-4cd7-a529-7dc771b24ffc] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 60940. Feb 04 18:09:06.744940 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-10e4f7d1-2aeb-489d-813f-0102e18ed644 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.793652 Feb 04 18:09:06.746652 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 457/921] 10.222.0.98 () {62 vars in 1187 bytes} [Fri Feb 4 18:09:04 2022] POST /compute/v2.1/servers => generated 400 bytes in 1797 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Feb 04 18:09:06.763461 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-03038190-c38b-41b7-b2f4-e47f588ee2c0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:06.764550 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-03038190-c38b-41b7-b2f4-e47f588ee2c0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:06.844023 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-03038190-c38b-41b7-b2f4-e47f588ee2c0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:06.858489 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-03038190-c38b-41b7-b2f4-e47f588ee2c0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:06.861522 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-03038190-c38b-41b7-b2f4-e47f588ee2c0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:06.863719 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-03038190-c38b-41b7-b2f4-e47f588ee2c0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1281 microversion: 2.20 time: 0.106874 Feb 04 18:09:06.865222 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 465/922] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:09:06 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1281 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:09:07.093849 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-dd24bece-7670-4bcc-aa27-c0ad0b380d59 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:07.094575 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-dd24bece-7670-4bcc-aa27-c0ad0b380d59 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:07.101680 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dd24bece-7670-4bcc-aa27-c0ad0b380d59 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:07.102141 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dd24bece-7670-4bcc-aa27-c0ad0b380d59 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:07.103002 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dd24bece-7670-4bcc-aa27-c0ad0b380d59 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:07.103568 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dd24bece-7670-4bcc-aa27-c0ad0b380d59 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:07.261773 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-dd24bece-7670-4bcc-aa27-c0ad0b380d59 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:07.269982 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-dd24bece-7670-4bcc-aa27-c0ad0b380d59 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1568 microversion: 2.1 time: 0.180296 Feb 04 18:09:07.270625 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 458/923] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:07 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:09:07.549493 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-4ac7226d-a19c-4475-bee9-668a798d6293 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:07.550142 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-4ac7226d-a19c-4475-bee9-668a798d6293 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:07.558532 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4ac7226d-a19c-4475-bee9-668a798d6293 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:07.558991 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4ac7226d-a19c-4475-bee9-668a798d6293 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:07.559862 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4ac7226d-a19c-4475-bee9-668a798d6293 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:07.560306 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4ac7226d-a19c-4475-bee9-668a798d6293 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:07.704007 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-4ac7226d-a19c-4475-bee9-668a798d6293 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:07.712592 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-4ac7226d-a19c-4475-bee9-668a798d6293 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1723 microversion: 2.1 time: 0.166785 Feb 04 18:09:07.713158 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 466/924] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:07 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:09:07.892243 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-6adff09b-c89b-441d-87c0-f5b9803fe1ff tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:07.892808 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-6adff09b-c89b-441d-87c0-f5b9803fe1ff tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:07.959956 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-6adff09b-c89b-441d-87c0-f5b9803fe1ff tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:07.967589 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-6adff09b-c89b-441d-87c0-f5b9803fe1ff tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:07.969313 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-6adff09b-c89b-441d-87c0-f5b9803fe1ff tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:07.971499 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-6adff09b-c89b-441d-87c0-f5b9803fe1ff tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1281 microversion: 2.20 time: 0.082968 Feb 04 18:09:07.972528 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 459/925] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:09:07 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1281 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:09:08.295824 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-c183eede-61ab-4615-9c83-bb7513f54816 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:08.296667 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-c183eede-61ab-4615-9c83-bb7513f54816 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:08.302972 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c183eede-61ab-4615-9c83-bb7513f54816 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:08.303433 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c183eede-61ab-4615-9c83-bb7513f54816 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:08.304231 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c183eede-61ab-4615-9c83-bb7513f54816 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:08.304679 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c183eede-61ab-4615-9c83-bb7513f54816 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:08.464720 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c183eede-61ab-4615-9c83-bb7513f54816 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:08.473855 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-c183eede-61ab-4615-9c83-bb7513f54816 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1568 microversion: 2.1 time: 0.181804 Feb 04 18:09:08.474624 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 467/926] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:08 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:08.731048 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-934ed471-58d4-4726-8d2d-15d1d7360b8d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:08.731798 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-934ed471-58d4-4726-8d2d-15d1d7360b8d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:08.742545 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-934ed471-58d4-4726-8d2d-15d1d7360b8d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:08.743007 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-934ed471-58d4-4726-8d2d-15d1d7360b8d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:08.744428 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-934ed471-58d4-4726-8d2d-15d1d7360b8d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:08.744883 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-934ed471-58d4-4726-8d2d-15d1d7360b8d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:08.920721 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-934ed471-58d4-4726-8d2d-15d1d7360b8d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:08.929358 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-934ed471-58d4-4726-8d2d-15d1d7360b8d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1723 microversion: 2.1 time: 0.203804 Feb 04 18:09:08.929931 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 460/927] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:08 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:08.992326 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-2a14e817-d160-4cd2-aeb0-a74c269fc9f3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:08.993231 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-2a14e817-d160-4cd2-aeb0-a74c269fc9f3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:09.000799 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2a14e817-d160-4cd2-aeb0-a74c269fc9f3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:09.001255 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2a14e817-d160-4cd2-aeb0-a74c269fc9f3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:09.006912 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2a14e817-d160-4cd2-aeb0-a74c269fc9f3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:09.006912 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2a14e817-d160-4cd2-aeb0-a74c269fc9f3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:09.087406 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2a14e817-d160-4cd2-aeb0-a74c269fc9f3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:09.097209 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2a14e817-d160-4cd2-aeb0-a74c269fc9f3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:09.099175 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2a14e817-d160-4cd2-aeb0-a74c269fc9f3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:09.100359 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-2a14e817-d160-4cd2-aeb0-a74c269fc9f3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1285 microversion: 2.20 time: 0.112543 Feb 04 18:09:09.100945 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 468/928] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:09:08 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:09:09.492635 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a7d9849a-b9ca-40e7-9f5d-3f1d1b174ad0 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:09.493427 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-a7d9849a-b9ca-40e7-9f5d-3f1d1b174ad0 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:09.501470 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a7d9849a-b9ca-40e7-9f5d-3f1d1b174ad0 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:09.502077 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a7d9849a-b9ca-40e7-9f5d-3f1d1b174ad0 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:09.503055 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a7d9849a-b9ca-40e7-9f5d-3f1d1b174ad0 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:09.503595 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a7d9849a-b9ca-40e7-9f5d-3f1d1b174ad0 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:09.677197 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-a7d9849a-b9ca-40e7-9f5d-3f1d1b174ad0 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:09.686076 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a7d9849a-b9ca-40e7-9f5d-3f1d1b174ad0 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1568 microversion: 2.1 time: 0.197653 Feb 04 18:09:09.687106 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 461/929] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:09 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:09.948544 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-dc2d0aeb-243d-4c36-a315-08931b116c77 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:09.948544 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-dc2d0aeb-243d-4c36-a315-08931b116c77 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:09.957606 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dc2d0aeb-243d-4c36-a315-08931b116c77 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:09.957606 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dc2d0aeb-243d-4c36-a315-08931b116c77 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:09.957606 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dc2d0aeb-243d-4c36-a315-08931b116c77 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:09.960484 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dc2d0aeb-243d-4c36-a315-08931b116c77 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:10.120880 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-bf0bfc4d-5fd3-4947-bc4a-9cafd29bd0ce tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:10.121493 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-bf0bfc4d-5fd3-4947-bc4a-9cafd29bd0ce tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:10.128673 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bf0bfc4d-5fd3-4947-bc4a-9cafd29bd0ce tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:10.129126 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bf0bfc4d-5fd3-4947-bc4a-9cafd29bd0ce tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:10.130067 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bf0bfc4d-5fd3-4947-bc4a-9cafd29bd0ce tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:10.130401 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bf0bfc4d-5fd3-4947-bc4a-9cafd29bd0ce tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:10.133429 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-dc2d0aeb-243d-4c36-a315-08931b116c77 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:10.143288 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-dc2d0aeb-243d-4c36-a315-08931b116c77 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1723 microversion: 2.1 time: 0.199574 Feb 04 18:09:10.144377 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 469/930] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:09 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:10.203290 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-bf0bfc4d-5fd3-4947-bc4a-9cafd29bd0ce tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:10.212590 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-bf0bfc4d-5fd3-4947-bc4a-9cafd29bd0ce tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:10.214207 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-bf0bfc4d-5fd3-4947-bc4a-9cafd29bd0ce tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:10.215574 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-bf0bfc4d-5fd3-4947-bc4a-9cafd29bd0ce tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1285 microversion: 2.20 time: 0.099088 Feb 04 18:09:10.216155 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 462/931] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:09:10 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:09:10.703772 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-72dc7c98-aa63-4e77-a52d-ef0cfe280761 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:10.704388 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-72dc7c98-aa63-4e77-a52d-ef0cfe280761 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:10.710490 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-72dc7c98-aa63-4e77-a52d-ef0cfe280761 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:10.710947 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-72dc7c98-aa63-4e77-a52d-ef0cfe280761 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:10.711736 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-72dc7c98-aa63-4e77-a52d-ef0cfe280761 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:10.712177 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-72dc7c98-aa63-4e77-a52d-ef0cfe280761 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:10.849240 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-72dc7c98-aa63-4e77-a52d-ef0cfe280761 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:10.856884 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-72dc7c98-aa63-4e77-a52d-ef0cfe280761 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1568 microversion: 2.1 time: 0.156785 Feb 04 18:09:10.857454 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 470/932] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:10 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:09:11.162060 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3f91d153-4870-49c2-8566-96be8c564d39 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:11.163076 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-3f91d153-4870-49c2-8566-96be8c564d39 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:11.184767 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3f91d153-4870-49c2-8566-96be8c564d39 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:11.185171 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3f91d153-4870-49c2-8566-96be8c564d39 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:11.186127 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3f91d153-4870-49c2-8566-96be8c564d39 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:11.186622 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3f91d153-4870-49c2-8566-96be8c564d39 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:11.234543 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-03006a92-1cb7-4827-a25d-143b4dada863 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:11.235354 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-03006a92-1cb7-4827-a25d-143b4dada863 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:11.243260 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-03006a92-1cb7-4827-a25d-143b4dada863 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:11.244475 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-03006a92-1cb7-4827-a25d-143b4dada863 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:11.245902 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-03006a92-1cb7-4827-a25d-143b4dada863 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:11.247003 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-03006a92-1cb7-4827-a25d-143b4dada863 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:11.364187 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-03006a92-1cb7-4827-a25d-143b4dada863 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:11.381749 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-03006a92-1cb7-4827-a25d-143b4dada863 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:11.385673 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-03006a92-1cb7-4827-a25d-143b4dada863 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:11.387842 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-03006a92-1cb7-4827-a25d-143b4dada863 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1341 microversion: 2.20 time: 0.157000 Feb 04 18:09:11.398085 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 471/933] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:09:11 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1341 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:09:11.420949 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-3f91d153-4870-49c2-8566-96be8c564d39 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:11.430034 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-3f91d153-4870-49c2-8566-96be8c564d39 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1723 microversion: 2.1 time: 0.272275 Feb 04 18:09:11.430644 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 463/934] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:11 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:11.874746 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ce1e1dd5-329f-4614-99b1-3de10fe22ccf tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:11.875571 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ce1e1dd5-329f-4614-99b1-3de10fe22ccf tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:11.882182 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ce1e1dd5-329f-4614-99b1-3de10fe22ccf tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:11.882729 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ce1e1dd5-329f-4614-99b1-3de10fe22ccf tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:11.883662 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ce1e1dd5-329f-4614-99b1-3de10fe22ccf tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:11.884153 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ce1e1dd5-329f-4614-99b1-3de10fe22ccf tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:12.085408 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-ce1e1dd5-329f-4614-99b1-3de10fe22ccf tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:12.096355 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ce1e1dd5-329f-4614-99b1-3de10fe22ccf tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1568 microversion: 2.1 time: 0.225326 Feb 04 18:09:12.097272 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 472/935] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:11 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:12.412016 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-9e67256a-efbc-4d80-a71d-850d846aa4fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:12.414099 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-9e67256a-efbc-4d80-a71d-850d846aa4fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:12.423584 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9e67256a-efbc-4d80-a71d-850d846aa4fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:12.424167 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9e67256a-efbc-4d80-a71d-850d846aa4fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:12.425051 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9e67256a-efbc-4d80-a71d-850d846aa4fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:12.425770 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9e67256a-efbc-4d80-a71d-850d846aa4fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:12.451630 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-6344f530-7001-41cd-a425-79c689f3f93a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:12.452646 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-6344f530-7001-41cd-a425-79c689f3f93a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:12.464388 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6344f530-7001-41cd-a425-79c689f3f93a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:12.465100 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6344f530-7001-41cd-a425-79c689f3f93a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:12.466332 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6344f530-7001-41cd-a425-79c689f3f93a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:12.468184 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6344f530-7001-41cd-a425-79c689f3f93a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:12.681123 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-9e67256a-efbc-4d80-a71d-850d846aa4fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:12.695150 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-9e67256a-efbc-4d80-a71d-850d846aa4fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:12.699149 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-9e67256a-efbc-4d80-a71d-850d846aa4fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:12.701257 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-9e67256a-efbc-4d80-a71d-850d846aa4fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1405 microversion: 2.20 time: 0.296288 Feb 04 18:09:12.702262 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 464/936] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:09:12 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1405 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:09:12.776609 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-6344f530-7001-41cd-a425-79c689f3f93a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:12.786172 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-6344f530-7001-41cd-a425-79c689f3f93a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1723 microversion: 2.1 time: 0.341708 Feb 04 18:09:12.798588 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 473/937] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:12 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1723 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:09:13.123858 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-94f3247b-0d67-4da7-b7f5-6eb5522f62dd tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:13.124694 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-94f3247b-0d67-4da7-b7f5-6eb5522f62dd tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:13.136277 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-94f3247b-0d67-4da7-b7f5-6eb5522f62dd tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:13.137049 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-94f3247b-0d67-4da7-b7f5-6eb5522f62dd tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:13.138603 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-94f3247b-0d67-4da7-b7f5-6eb5522f62dd tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:13.139665 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-94f3247b-0d67-4da7-b7f5-6eb5522f62dd tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:13.375338 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-94f3247b-0d67-4da7-b7f5-6eb5522f62dd tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:13.380589 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-94f3247b-0d67-4da7-b7f5-6eb5522f62dd tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1569 microversion: 2.1 time: 0.261816 Feb 04 18:09:13.381172 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 465/938] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:13 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1569 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:13.404166 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-bd2fadfc-7593-42cb-9c55-f1c9a271138d tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:09:13.404166 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-bd2fadfc-7593-42cb-9c55-f1c9a271138d tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:13.416416 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bd2fadfc-7593-42cb-9c55-f1c9a271138d tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:13.417209 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bd2fadfc-7593-42cb-9c55-f1c9a271138d tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:13.418836 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bd2fadfc-7593-42cb-9c55-f1c9a271138d tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:13.419615 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bd2fadfc-7593-42cb-9c55-f1c9a271138d tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:13.498020 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-9222a841-167a-44fe-a9d6-7b16e2265024 req-d0bf8d7f-d7f7-4b41-956d-5fb46c765d4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32416d02-187d-4d8f-9698-d36ac5ffbc26", "tag": "8dbc5ea2-225d-4915-8e59-f39e014f906a"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:09:13.503324 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:09:13.503324 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:09:13.522460 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-9222a841-167a-44fe-a9d6-7b16e2265024 req-d0bf8d7f-d7f7-4b41-956d-5fb46c765d4f service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:13.523559 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-9222a841-167a-44fe-a9d6-7b16e2265024 req-d0bf8d7f-d7f7-4b41-956d-5fb46c765d4f service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:13.548143 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-9222a841-167a-44fe-a9d6-7b16e2265024 req-d0bf8d7f-d7f7-4b41-956d-5fb46c765d4f service nova] Creating event network-changed:8dbc5ea2-225d-4915-8e59-f39e014f906a for instance 32416d02-187d-4d8f-9698-d36ac5ffbc26 on hv-cinder-82276 Feb 04 18:09:13.557942 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-9222a841-167a-44fe-a9d6-7b16e2265024 req-d0bf8d7f-d7f7-4b41-956d-5fb46c765d4f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076190 Feb 04 18:09:13.559297 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 466/939] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:09:13.734986 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-96f90d12-b2b6-4d4b-9f00-9401b9b5e5a9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:13.736272 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-96f90d12-b2b6-4d4b-9f00-9401b9b5e5a9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:13.746571 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-96f90d12-b2b6-4d4b-9f00-9401b9b5e5a9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:13.747622 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-96f90d12-b2b6-4d4b-9f00-9401b9b5e5a9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:13.748746 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-96f90d12-b2b6-4d4b-9f00-9401b9b5e5a9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:13.749503 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-96f90d12-b2b6-4d4b-9f00-9401b9b5e5a9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:13.785510 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-bd2fadfc-7593-42cb-9c55-f1c9a271138d tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "POST /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1/action" status: 202 len: 0 microversion: 2.1 time: 0.388927 Feb 04 18:09:13.788323 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 474/940] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Feb 4 18:09:13 2022] POST /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 04 18:09:13.806652 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ff9e4848-15b4-49f1-8feb-29c29413dc7c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:13.807995 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ff9e4848-15b4-49f1-8feb-29c29413dc7c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:13.821278 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ff9e4848-15b4-49f1-8feb-29c29413dc7c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:13.822642 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ff9e4848-15b4-49f1-8feb-29c29413dc7c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:13.824217 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ff9e4848-15b4-49f1-8feb-29c29413dc7c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:13.825539 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ff9e4848-15b4-49f1-8feb-29c29413dc7c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:13.999619 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-96f90d12-b2b6-4d4b-9f00-9401b9b5e5a9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:14.008587 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-96f90d12-b2b6-4d4b-9f00-9401b9b5e5a9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:14.010856 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-96f90d12-b2b6-4d4b-9f00-9401b9b5e5a9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:14.012235 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-96f90d12-b2b6-4d4b-9f00-9401b9b5e5a9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1405 microversion: 2.20 time: 0.285950 Feb 04 18:09:14.012832 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 467/941] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:09:13 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1405 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:09:14.018034 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-76958d9b-f7bd-4d77-aa02-e80564f69ad0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:14.019017 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-76958d9b-f7bd-4d77-aa02-e80564f69ad0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:14.028058 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-76958d9b-f7bd-4d77-aa02-e80564f69ad0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:14.034875 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-76958d9b-f7bd-4d77-aa02-e80564f69ad0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:14.035802 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-76958d9b-f7bd-4d77-aa02-e80564f69ad0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:14.036537 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-76958d9b-f7bd-4d77-aa02-e80564f69ad0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:14.111293 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-ff9e4848-15b4-49f1-8feb-29c29413dc7c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:14.121441 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ff9e4848-15b4-49f1-8feb-29c29413dc7c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1517 microversion: 2.1 time: 0.325366 Feb 04 18:09:14.122991 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 475/942] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:13 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1517 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:14.275003 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-76958d9b-f7bd-4d77-aa02-e80564f69ad0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:14.286004 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-76958d9b-f7bd-4d77-aa02-e80564f69ad0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1723 microversion: 2.1 time: 0.272080 Feb 04 18:09:14.287028 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 468/943] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:14 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1723 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:15.042193 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-1438fd3f-0485-4a2b-bc6f-c2fc1c73f146 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:15.043608 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-1438fd3f-0485-4a2b-bc6f-c2fc1c73f146 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:15.051672 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1438fd3f-0485-4a2b-bc6f-c2fc1c73f146 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:15.052284 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1438fd3f-0485-4a2b-bc6f-c2fc1c73f146 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:15.053503 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1438fd3f-0485-4a2b-bc6f-c2fc1c73f146 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:15.054051 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1438fd3f-0485-4a2b-bc6f-c2fc1c73f146 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:15.145508 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-8f73cca7-6ed5-4354-8ce1-a7eb593e3cf7 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:15.146352 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-8f73cca7-6ed5-4354-8ce1-a7eb593e3cf7 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:15.159979 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8f73cca7-6ed5-4354-8ce1-a7eb593e3cf7 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:15.161688 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8f73cca7-6ed5-4354-8ce1-a7eb593e3cf7 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:15.163264 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8f73cca7-6ed5-4354-8ce1-a7eb593e3cf7 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:15.164196 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8f73cca7-6ed5-4354-8ce1-a7eb593e3cf7 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:15.314880 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-1438fd3f-0485-4a2b-bc6f-c2fc1c73f146 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:15.333523 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-1438fd3f-0485-4a2b-bc6f-c2fc1c73f146 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:15.336974 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-1438fd3f-0485-4a2b-bc6f-c2fc1c73f146 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:15.340199 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-1438fd3f-0485-4a2b-bc6f-c2fc1c73f146 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1405 microversion: 2.20 time: 0.302127 Feb 04 18:09:15.341640 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 476/944] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:09:15 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1405 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:09:15.351950 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-98057889-6261-489d-b043-e2a7d37536ce tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:15.353750 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-98057889-6261-489d-b043-e2a7d37536ce tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:15.366591 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-98057889-6261-489d-b043-e2a7d37536ce tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:15.367359 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-98057889-6261-489d-b043-e2a7d37536ce tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:15.369200 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-98057889-6261-489d-b043-e2a7d37536ce tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:15.370256 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-98057889-6261-489d-b043-e2a7d37536ce tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:15.428999 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-8f73cca7-6ed5-4354-8ce1-a7eb593e3cf7 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:15.441502 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-8f73cca7-6ed5-4354-8ce1-a7eb593e3cf7 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1519 microversion: 2.1 time: 0.304129 Feb 04 18:09:15.446981 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 469/945] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:15 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1519 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:15.459661 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-88655072-1954-4824-b3cc-5c38070bf8c3 req-955176a8-6fe0-4b1f-820e-439748556c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c4e346-86a3-4ecf-b0a8-5de2dced1ef1", "name": "network-vif-unplugged", "status": "completed", "tag": "a8ca804a-2879-4f45-91f3-f7ace366691d"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:09:15.462541 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:09:15.462541 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:09:15.474326 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-88655072-1954-4824-b3cc-5c38070bf8c3 req-955176a8-6fe0-4b1f-820e-439748556c1c service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:15.475010 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-88655072-1954-4824-b3cc-5c38070bf8c3 req-955176a8-6fe0-4b1f-820e-439748556c1c service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:15.495220 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.compute.server_external_events [req-88655072-1954-4824-b3cc-5c38070bf8c3 req-955176a8-6fe0-4b1f-820e-439748556c1c service nova] Unable to find a host for instance 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1. Dropping event network-vif-unplugged {{(pid=123567) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 04 18:09:15.496482 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-88655072-1954-4824-b3cc-5c38070bf8c3 req-955176a8-6fe0-4b1f-820e-439748556c1c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.047001 Feb 04 18:09:15.497485 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 470/946] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 50 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 04 18:09:15.552808 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-98057889-6261-489d-b043-e2a7d37536ce tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:15.564012 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-98057889-6261-489d-b043-e2a7d37536ce tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1723 microversion: 2.1 time: 0.220153 Feb 04 18:09:15.564835 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 477/947] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:15 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:16.369335 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-ebdc6cc3-e482-4bc8-b515-3d427c48553e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:16.370487 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-ebdc6cc3-e482-4bc8-b515-3d427c48553e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:16.378079 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ebdc6cc3-e482-4bc8-b515-3d427c48553e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:16.378695 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ebdc6cc3-e482-4bc8-b515-3d427c48553e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:16.379592 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ebdc6cc3-e482-4bc8-b515-3d427c48553e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:16.380121 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ebdc6cc3-e482-4bc8-b515-3d427c48553e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:16.466672 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-69a870e8-17cf-482b-97de-1b5bdb84c8f6 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:16.467521 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-69a870e8-17cf-482b-97de-1b5bdb84c8f6 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:16.475334 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-69a870e8-17cf-482b-97de-1b5bdb84c8f6 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:16.476012 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-69a870e8-17cf-482b-97de-1b5bdb84c8f6 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:16.477108 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-69a870e8-17cf-482b-97de-1b5bdb84c8f6 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:16.477706 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-69a870e8-17cf-482b-97de-1b5bdb84c8f6 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:16.541111 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ebdc6cc3-e482-4bc8-b515-3d427c48553e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:16.551677 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ebdc6cc3-e482-4bc8-b515-3d427c48553e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:16.553630 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ebdc6cc3-e482-4bc8-b515-3d427c48553e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:16.555267 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-ebdc6cc3-e482-4bc8-b515-3d427c48553e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1405 microversion: 2.20 time: 0.190843 Feb 04 18:09:16.555961 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 471/948] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:09:16 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1405 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:09:16.583538 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-1734f216-fd31-4698-bd18-cf541962d29d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:16.584411 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-1734f216-fd31-4698-bd18-cf541962d29d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:16.594289 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1734f216-fd31-4698-bd18-cf541962d29d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:16.595053 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1734f216-fd31-4698-bd18-cf541962d29d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:16.596313 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1734f216-fd31-4698-bd18-cf541962d29d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:16.597028 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1734f216-fd31-4698-bd18-cf541962d29d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:16.934592 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-69a870e8-17cf-482b-97de-1b5bdb84c8f6 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:16.942968 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-69a870e8-17cf-482b-97de-1b5bdb84c8f6 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1519 microversion: 2.1 time: 0.481326 Feb 04 18:09:16.943557 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 478/949] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:16 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1519 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:09:17.047694 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-1734f216-fd31-4698-bd18-cf541962d29d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:17.057008 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-1734f216-fd31-4698-bd18-cf541962d29d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1723 microversion: 2.1 time: 0.477544 Feb 04 18:09:17.057594 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 472/950] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:16 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1723 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:09:17.582512 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-311ffd56-6fe4-4493-9839-9338cfacc62f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:17.583117 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-311ffd56-6fe4-4493-9839-9338cfacc62f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:17.590599 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-311ffd56-6fe4-4493-9839-9338cfacc62f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:17.591050 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-311ffd56-6fe4-4493-9839-9338cfacc62f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:17.591832 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-311ffd56-6fe4-4493-9839-9338cfacc62f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:17.592289 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-311ffd56-6fe4-4493-9839-9338cfacc62f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:17.769944 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-311ffd56-6fe4-4493-9839-9338cfacc62f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:17.788322 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-311ffd56-6fe4-4493-9839-9338cfacc62f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:17.791686 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-311ffd56-6fe4-4493-9839-9338cfacc62f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:17.793380 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-311ffd56-6fe4-4493-9839-9338cfacc62f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1405 microversion: 2.20 time: 0.214703 Feb 04 18:09:17.794164 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 479/951] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:09:17 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1405 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:09:17.964153 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-0262d0d0-7e77-4b66-a9ee-ff45a03fb277 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:17.965083 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-0262d0d0-7e77-4b66-a9ee-ff45a03fb277 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:17.973948 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0262d0d0-7e77-4b66-a9ee-ff45a03fb277 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:17.975170 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0262d0d0-7e77-4b66-a9ee-ff45a03fb277 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:17.976615 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0262d0d0-7e77-4b66-a9ee-ff45a03fb277 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:17.977663 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0262d0d0-7e77-4b66-a9ee-ff45a03fb277 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:18.077546 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-c185c301-c454-43d1-bcd0-dafd8292a19a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:18.078738 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-c185c301-c454-43d1-bcd0-dafd8292a19a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:18.090101 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c185c301-c454-43d1-bcd0-dafd8292a19a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:18.090940 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c185c301-c454-43d1-bcd0-dafd8292a19a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:18.092410 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c185c301-c454-43d1-bcd0-dafd8292a19a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:18.093009 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c185c301-c454-43d1-bcd0-dafd8292a19a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:18.167227 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-0262d0d0-7e77-4b66-a9ee-ff45a03fb277 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:18.190329 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-0262d0d0-7e77-4b66-a9ee-ff45a03fb277 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1575 microversion: 2.1 time: 0.231586 Feb 04 18:09:18.193015 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 473/952] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:17 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1575 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:09:18.343991 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c185c301-c454-43d1-bcd0-dafd8292a19a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:18.360696 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-c185c301-c454-43d1-bcd0-dafd8292a19a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1723 microversion: 2.1 time: 0.288921 Feb 04 18:09:18.361885 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 480/953] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:18 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1723 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:09:18.820263 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-d7b069eb-c497-4862-8dfc-77002e478227 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:18.820890 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-d7b069eb-c497-4862-8dfc-77002e478227 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:18.827269 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d7b069eb-c497-4862-8dfc-77002e478227 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:18.827720 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d7b069eb-c497-4862-8dfc-77002e478227 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:18.828531 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d7b069eb-c497-4862-8dfc-77002e478227 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:18.828971 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d7b069eb-c497-4862-8dfc-77002e478227 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:18.996985 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-d7b069eb-c497-4862-8dfc-77002e478227 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:19.006550 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-d7b069eb-c497-4862-8dfc-77002e478227 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:19.008224 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-d7b069eb-c497-4862-8dfc-77002e478227 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:19.009483 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-d7b069eb-c497-4862-8dfc-77002e478227 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1405 microversion: 2.20 time: 0.193140 Feb 04 18:09:19.010108 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 474/954] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:09:18 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:09:19.215970 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-d81fdff9-517b-4738-8148-bc0f00dc63d1 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:19.217030 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-d81fdff9-517b-4738-8148-bc0f00dc63d1 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:19.223435 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d81fdff9-517b-4738-8148-bc0f00dc63d1 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:19.223886 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d81fdff9-517b-4738-8148-bc0f00dc63d1 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:19.224683 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d81fdff9-517b-4738-8148-bc0f00dc63d1 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:19.225122 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d81fdff9-517b-4738-8148-bc0f00dc63d1 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:19.387038 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-983b0f3e-850c-4395-8684-32f4e38a1703 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:19.388157 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-983b0f3e-850c-4395-8684-32f4e38a1703 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:19.398388 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-983b0f3e-850c-4395-8684-32f4e38a1703 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:19.399155 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-983b0f3e-850c-4395-8684-32f4e38a1703 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:19.401184 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-d81fdff9-517b-4738-8148-bc0f00dc63d1 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:19.401379 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-983b0f3e-850c-4395-8684-32f4e38a1703 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:19.402103 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-983b0f3e-850c-4395-8684-32f4e38a1703 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:19.415036 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-d81fdff9-517b-4738-8148-bc0f00dc63d1 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1575 microversion: 2.1 time: 0.203224 Feb 04 18:09:19.416539 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 481/955] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:19 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1575 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:19.477368 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-b0ed5934-a447-4150-bbb6-0e9e4f143f6c req-0fd5d1db-3b3f-4989-b197-d2dab993363a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32416d02-187d-4d8f-9698-d36ac5ffbc26", "name": "network-vif-plugged", "status": "completed", "tag": "8dbc5ea2-225d-4915-8e59-f39e014f906a"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:09:19.483712 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:09:19.483712 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:09:19.494925 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-b0ed5934-a447-4150-bbb6-0e9e4f143f6c req-0fd5d1db-3b3f-4989-b197-d2dab993363a service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:19.495741 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-b0ed5934-a447-4150-bbb6-0e9e4f143f6c req-0fd5d1db-3b3f-4989-b197-d2dab993363a service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:19.516898 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-b0ed5934-a447-4150-bbb6-0e9e4f143f6c req-0fd5d1db-3b3f-4989-b197-d2dab993363a service nova] Creating event network-vif-plugged:8dbc5ea2-225d-4915-8e59-f39e014f906a for instance 32416d02-187d-4d8f-9698-d36ac5ffbc26 on hv-cinder-82276 Feb 04 18:09:19.526480 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-b0ed5934-a447-4150-bbb6-0e9e4f143f6c req-0fd5d1db-3b3f-4989-b197-d2dab993363a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056200 Feb 04 18:09:19.527548 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 482/956] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:09:19.626678 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-983b0f3e-850c-4395-8684-32f4e38a1703 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:19.636057 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-983b0f3e-850c-4395-8684-32f4e38a1703 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1723 microversion: 2.1 time: 0.256308 Feb 04 18:09:19.636925 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 475/957] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:19 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:09:20.029156 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-c467d2c9-f91c-4570-864a-0c24736a323e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:20.029859 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-c467d2c9-f91c-4570-864a-0c24736a323e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:20.036130 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c467d2c9-f91c-4570-864a-0c24736a323e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:20.036576 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c467d2c9-f91c-4570-864a-0c24736a323e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:20.037362 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c467d2c9-f91c-4570-864a-0c24736a323e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:20.037796 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c467d2c9-f91c-4570-864a-0c24736a323e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:20.180008 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c467d2c9-f91c-4570-864a-0c24736a323e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:20.188484 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c467d2c9-f91c-4570-864a-0c24736a323e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:20.190060 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c467d2c9-f91c-4570-864a-0c24736a323e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:20.191211 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-c467d2c9-f91c-4570-864a-0c24736a323e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1405 microversion: 2.20 time: 0.167068 Feb 04 18:09:20.191785 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 483/958] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:09:20 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:09:20.440553 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-afe3b2a6-1ca6-48ef-a0a1-ff93f1e429d8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:20.441442 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-afe3b2a6-1ca6-48ef-a0a1-ff93f1e429d8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:20.448470 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-afe3b2a6-1ca6-48ef-a0a1-ff93f1e429d8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:20.448917 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-afe3b2a6-1ca6-48ef-a0a1-ff93f1e429d8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:20.449706 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-afe3b2a6-1ca6-48ef-a0a1-ff93f1e429d8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:20.450315 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-afe3b2a6-1ca6-48ef-a0a1-ff93f1e429d8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:20.601251 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-afe3b2a6-1ca6-48ef-a0a1-ff93f1e429d8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:20.609285 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-afe3b2a6-1ca6-48ef-a0a1-ff93f1e429d8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1575 microversion: 2.1 time: 0.172355 Feb 04 18:09:20.609909 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 476/959] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:20 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:20.653096 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-d0bd86d4-3e05-46c0-beae-94c7113ca236 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:20.653691 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-d0bd86d4-3e05-46c0-beae-94c7113ca236 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:20.660268 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d0bd86d4-3e05-46c0-beae-94c7113ca236 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:20.660713 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d0bd86d4-3e05-46c0-beae-94c7113ca236 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:20.661501 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d0bd86d4-3e05-46c0-beae-94c7113ca236 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:20.661967 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d0bd86d4-3e05-46c0-beae-94c7113ca236 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:20.809645 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-d0bd86d4-3e05-46c0-beae-94c7113ca236 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:20.819337 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-d0bd86d4-3e05-46c0-beae-94c7113ca236 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1723 microversion: 2.1 time: 0.169892 Feb 04 18:09:20.820292 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 484/960] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:20 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:21.209779 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-01658115-2c7a-4971-a654-4e2a256e03ae tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:21.210412 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-01658115-2c7a-4971-a654-4e2a256e03ae tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:21.217473 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-01658115-2c7a-4971-a654-4e2a256e03ae tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:21.217934 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-01658115-2c7a-4971-a654-4e2a256e03ae tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:21.218818 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-01658115-2c7a-4971-a654-4e2a256e03ae tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:21.219278 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-01658115-2c7a-4971-a654-4e2a256e03ae tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:21.378333 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-01658115-2c7a-4971-a654-4e2a256e03ae tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:21.393489 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-01658115-2c7a-4971-a654-4e2a256e03ae tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:21.396909 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-01658115-2c7a-4971-a654-4e2a256e03ae tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:21.399042 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-01658115-2c7a-4971-a654-4e2a256e03ae tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1405 microversion: 2.20 time: 0.192746 Feb 04 18:09:21.400622 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 477/961] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:09:21 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1405 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:09:21.627776 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-0dbd88e1-ca74-4a43-abfe-b2c4b6630bb8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:21.628562 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-0dbd88e1-ca74-4a43-abfe-b2c4b6630bb8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:21.635613 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0dbd88e1-ca74-4a43-abfe-b2c4b6630bb8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:21.636100 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0dbd88e1-ca74-4a43-abfe-b2c4b6630bb8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:21.636900 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0dbd88e1-ca74-4a43-abfe-b2c4b6630bb8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:21.637330 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0dbd88e1-ca74-4a43-abfe-b2c4b6630bb8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:21.794701 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-0dbd88e1-ca74-4a43-abfe-b2c4b6630bb8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:21.802973 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-0dbd88e1-ca74-4a43-abfe-b2c4b6630bb8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1575 microversion: 2.1 time: 0.178847 Feb 04 18:09:21.805168 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 485/962] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:21 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:21.853878 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a76959a6-ca8d-4bd0-bcbc-b303d146dd43 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:21.854668 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-a76959a6-ca8d-4bd0-bcbc-b303d146dd43 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:21.861685 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a76959a6-ca8d-4bd0-bcbc-b303d146dd43 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:21.862153 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a76959a6-ca8d-4bd0-bcbc-b303d146dd43 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:21.863055 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a76959a6-ca8d-4bd0-bcbc-b303d146dd43 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:21.863499 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a76959a6-ca8d-4bd0-bcbc-b303d146dd43 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:22.032868 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-a76959a6-ca8d-4bd0-bcbc-b303d146dd43 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:22.042523 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a76959a6-ca8d-4bd0-bcbc-b303d146dd43 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1723 microversion: 2.1 time: 0.193024 Feb 04 18:09:22.043431 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 478/963] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:21 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:09:22.427883 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b6bf3b17-dea3-44dd-879c-28d1a40ee08f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:22.428500 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-b6bf3b17-dea3-44dd-879c-28d1a40ee08f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:22.435360 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b6bf3b17-dea3-44dd-879c-28d1a40ee08f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:22.435890 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b6bf3b17-dea3-44dd-879c-28d1a40ee08f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:22.436809 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b6bf3b17-dea3-44dd-879c-28d1a40ee08f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:22.437347 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b6bf3b17-dea3-44dd-879c-28d1a40ee08f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:22.605764 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-b6bf3b17-dea3-44dd-879c-28d1a40ee08f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:22.615178 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-b6bf3b17-dea3-44dd-879c-28d1a40ee08f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:22.616877 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-b6bf3b17-dea3-44dd-879c-28d1a40ee08f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:22.618117 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-b6bf3b17-dea3-44dd-879c-28d1a40ee08f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1595 microversion: 2.20 time: 0.194077 Feb 04 18:09:22.619250 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 486/964] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:09:22 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1595 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:09:22.638033 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-53f46766-f69c-4071-bde9-152599f9de64 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:22.638592 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-53f46766-f69c-4071-bde9-152599f9de64 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:22.645328 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-53f46766-f69c-4071-bde9-152599f9de64 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:22.645789 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-53f46766-f69c-4071-bde9-152599f9de64 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:22.646706 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-53f46766-f69c-4071-bde9-152599f9de64 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:22.647160 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-53f46766-f69c-4071-bde9-152599f9de64 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:22.742615 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-53f46766-f69c-4071-bde9-152599f9de64 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.108779 Feb 04 18:09:22.744219 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 479/965] 10.222.0.98 () {60 vars in 1315 bytes} [Fri Feb 4 18:09:22 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 04 18:09:22.822215 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-a7ac19bc-98af-43bf-ab55-b6474292bbaa tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:22.823225 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-a7ac19bc-98af-43bf-ab55-b6474292bbaa tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:22.830595 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a7ac19bc-98af-43bf-ab55-b6474292bbaa tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:22.831181 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a7ac19bc-98af-43bf-ab55-b6474292bbaa tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:22.832068 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a7ac19bc-98af-43bf-ab55-b6474292bbaa tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:22.832632 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a7ac19bc-98af-43bf-ab55-b6474292bbaa tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:22.986231 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-a7ac19bc-98af-43bf-ab55-b6474292bbaa tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:22.995217 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-a7ac19bc-98af-43bf-ab55-b6474292bbaa tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1575 microversion: 2.1 time: 0.177537 Feb 04 18:09:22.995843 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 487/966] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:22 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:09:23.069490 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-cad4746f-939c-4f60-829a-0d39170d3e6e tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:23.070174 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-cad4746f-939c-4f60-829a-0d39170d3e6e tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:23.076373 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cad4746f-939c-4f60-829a-0d39170d3e6e tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:23.076825 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cad4746f-939c-4f60-829a-0d39170d3e6e tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:23.077632 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cad4746f-939c-4f60-829a-0d39170d3e6e tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:23.078082 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cad4746f-939c-4f60-829a-0d39170d3e6e tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:23.238231 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-cad4746f-939c-4f60-829a-0d39170d3e6e tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:23.254045 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-cad4746f-939c-4f60-829a-0d39170d3e6e tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1700 microversion: 2.1 time: 0.188167 Feb 04 18:09:23.255023 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 480/967] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:23 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1700 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:23.285657 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-daa24da1-8e4d-43d3-b910-5e8fc3705312 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:09:23.293391 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-daa24da1-8e4d-43d3-b910-5e8fc3705312 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:23.293997 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-daa24da1-8e4d-43d3-b910-5e8fc3705312 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:23.362865 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-daa24da1-8e4d-43d3-b910-5e8fc3705312 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Going to try to start instance {{(pid=123566) start /opt/stack/nova/nova/compute/api.py:2678}} Feb 04 18:09:23.588777 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-daa24da1-8e4d-43d3-b910-5e8fc3705312 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "POST /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c/action" status: 202 len: 0 microversion: 2.1 time: 0.307085 Feb 04 18:09:23.589504 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 488/968] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Feb 4 18:09:23 2022] POST /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 04 18:09:23.601865 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-9a74fbb3-a162-4061-afea-be3b346c1cd3 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:23.603056 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-9a74fbb3-a162-4061-afea-be3b346c1cd3 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:23.613022 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9a74fbb3-a162-4061-afea-be3b346c1cd3 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:23.613651 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9a74fbb3-a162-4061-afea-be3b346c1cd3 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:23.614954 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9a74fbb3-a162-4061-afea-be3b346c1cd3 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:23.615555 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9a74fbb3-a162-4061-afea-be3b346c1cd3 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:23.801252 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-9a74fbb3-a162-4061-afea-be3b346c1cd3 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:23.813485 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-9a74fbb3-a162-4061-afea-be3b346c1cd3 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1709 microversion: 2.1 time: 0.218595 Feb 04 18:09:23.814400 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 481/969] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:23 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1709 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:24.014185 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-2558e8fa-2ed5-4c6f-aac9-8d92be0dc685 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:24.015047 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-2558e8fa-2ed5-4c6f-aac9-8d92be0dc685 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:24.021993 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2558e8fa-2ed5-4c6f-aac9-8d92be0dc685 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:24.022600 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2558e8fa-2ed5-4c6f-aac9-8d92be0dc685 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:24.023489 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2558e8fa-2ed5-4c6f-aac9-8d92be0dc685 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:24.024123 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2558e8fa-2ed5-4c6f-aac9-8d92be0dc685 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:24.222400 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2558e8fa-2ed5-4c6f-aac9-8d92be0dc685 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:24.235325 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-2558e8fa-2ed5-4c6f-aac9-8d92be0dc685 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1575 microversion: 2.1 time: 0.225677 Feb 04 18:09:24.236406 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 489/970] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:24 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1575 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:09:24.659939 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-bce7519f-110e-4ad6-afb6-a5d7c817f71b req-23778fa4-d232-41f1-8740-6b6cfe608a65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32416d02-187d-4d8f-9698-d36ac5ffbc26", "tag": "8dbc5ea2-225d-4915-8e59-f39e014f906a"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:09:24.660132 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-4ad1ac27-0338-4976-aeff-6ec225e3c217 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:24.661579 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-4ad1ac27-0338-4976-aeff-6ec225e3c217 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:24.663564 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:09:24.663564 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:09:24.676422 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4ad1ac27-0338-4976-aeff-6ec225e3c217 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:24.677933 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4ad1ac27-0338-4976-aeff-6ec225e3c217 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:24.681006 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4ad1ac27-0338-4976-aeff-6ec225e3c217 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:24.681887 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4ad1ac27-0338-4976-aeff-6ec225e3c217 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:24.682285 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-bce7519f-110e-4ad6-afb6-a5d7c817f71b req-23778fa4-d232-41f1-8740-6b6cfe608a65 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:24.683200 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-bce7519f-110e-4ad6-afb6-a5d7c817f71b req-23778fa4-d232-41f1-8740-6b6cfe608a65 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:24.707332 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-bce7519f-110e-4ad6-afb6-a5d7c817f71b req-23778fa4-d232-41f1-8740-6b6cfe608a65 service nova] Creating event network-changed:8dbc5ea2-225d-4915-8e59-f39e014f906a for instance 32416d02-187d-4d8f-9698-d36ac5ffbc26 on hv-cinder-82276 Feb 04 18:09:24.718105 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-bce7519f-110e-4ad6-afb6-a5d7c817f71b req-23778fa4-d232-41f1-8740-6b6cfe608a65 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064765 Feb 04 18:09:24.720993 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 490/971] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:09:24.844568 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-6fcca896-984e-423e-8ba5-0f80f79f00c9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:24.845938 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-6fcca896-984e-423e-8ba5-0f80f79f00c9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:24.866198 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6fcca896-984e-423e-8ba5-0f80f79f00c9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:24.866894 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6fcca896-984e-423e-8ba5-0f80f79f00c9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:24.867529 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6fcca896-984e-423e-8ba5-0f80f79f00c9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:24.867981 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6fcca896-984e-423e-8ba5-0f80f79f00c9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:24.918523 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-4ad1ac27-0338-4976-aeff-6ec225e3c217 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:24.941353 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-4ad1ac27-0338-4976-aeff-6ec225e3c217 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:24.944048 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-4ad1ac27-0338-4976-aeff-6ec225e3c217 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:24.945598 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-4ad1ac27-0338-4976-aeff-6ec225e3c217 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1595 microversion: 2.20 time: 0.295545 Feb 04 18:09:24.947284 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 482/972] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:09:24 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1595 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:09:25.110164 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-6fcca896-984e-423e-8ba5-0f80f79f00c9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:25.144471 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-6fcca896-984e-423e-8ba5-0f80f79f00c9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1709 microversion: 2.1 time: 0.306464 Feb 04 18:09:25.154121 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 491/973] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:24 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1709 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:25.260985 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-6e526884-cc99-444a-94f9-567eddcc3fc7 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:25.262218 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-6e526884-cc99-444a-94f9-567eddcc3fc7 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:25.272051 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6e526884-cc99-444a-94f9-567eddcc3fc7 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:25.272792 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6e526884-cc99-444a-94f9-567eddcc3fc7 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:25.274113 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6e526884-cc99-444a-94f9-567eddcc3fc7 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:25.274821 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6e526884-cc99-444a-94f9-567eddcc3fc7 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:25.519406 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-6e526884-cc99-444a-94f9-567eddcc3fc7 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:25.533891 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-6e526884-cc99-444a-94f9-567eddcc3fc7 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1575 microversion: 2.1 time: 0.276566 Feb 04 18:09:25.535049 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 483/974] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:25 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1575 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:25.976424 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-18086186-d8a6-49fd-9fd2-8151d0076db5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:25.977977 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-18086186-d8a6-49fd-9fd2-8151d0076db5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:25.986033 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-18086186-d8a6-49fd-9fd2-8151d0076db5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:25.986631 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-18086186-d8a6-49fd-9fd2-8151d0076db5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:25.987631 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-18086186-d8a6-49fd-9fd2-8151d0076db5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:25.988060 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-18086186-d8a6-49fd-9fd2-8151d0076db5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:26.169810 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-450f38f6-523c-4294-a1d5-15fa5186d54b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:26.179552 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-450f38f6-523c-4294-a1d5-15fa5186d54b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:26.192326 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-450f38f6-523c-4294-a1d5-15fa5186d54b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:26.193561 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-450f38f6-523c-4294-a1d5-15fa5186d54b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:26.195403 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-450f38f6-523c-4294-a1d5-15fa5186d54b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:26.197295 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-450f38f6-523c-4294-a1d5-15fa5186d54b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:26.215304 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-18086186-d8a6-49fd-9fd2-8151d0076db5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:26.229493 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-18086186-d8a6-49fd-9fd2-8151d0076db5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:26.232750 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-18086186-d8a6-49fd-9fd2-8151d0076db5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:26.234791 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-18086186-d8a6-49fd-9fd2-8151d0076db5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1714 microversion: 2.20 time: 0.264412 Feb 04 18:09:26.236494 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 492/975] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:09:25 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1714 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:09:26.268480 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-7def3e51-69fb-40d2-a1ee-945a5fa8601c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:26.269378 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-7def3e51-69fb-40d2-a1ee-945a5fa8601c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:26.278276 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7def3e51-69fb-40d2-a1ee-945a5fa8601c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:26.278952 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7def3e51-69fb-40d2-a1ee-945a5fa8601c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:26.279947 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7def3e51-69fb-40d2-a1ee-945a5fa8601c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:26.280733 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7def3e51-69fb-40d2-a1ee-945a5fa8601c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:26.325049 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-7def3e51-69fb-40d2-a1ee-945a5fa8601c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26/ips" status: 200 len: 150 microversion: 2.20 time: 0.063819 Feb 04 18:09:26.326113 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 493/976] 10.222.0.98 () {60 vars in 1288 bytes} [Fri Feb 4 18:09:26 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26/ips => generated 150 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 04 18:09:26.428392 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-450f38f6-523c-4294-a1d5-15fa5186d54b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:26.439702 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-450f38f6-523c-4294-a1d5-15fa5186d54b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1713 microversion: 2.1 time: 0.281200 Feb 04 18:09:26.440483 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 484/977] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:26 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1713 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:09:26.560745 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-e1225e85-953e-4f98-a060-a9ff4e18b029 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:26.561433 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-e1225e85-953e-4f98-a060-a9ff4e18b029 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:26.568306 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e1225e85-953e-4f98-a060-a9ff4e18b029 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:26.568777 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e1225e85-953e-4f98-a060-a9ff4e18b029 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:26.569597 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e1225e85-953e-4f98-a060-a9ff4e18b029 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:26.570044 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e1225e85-953e-4f98-a060-a9ff4e18b029 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:26.740626 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-e1225e85-953e-4f98-a060-a9ff4e18b029 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:26.752930 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-e1225e85-953e-4f98-a060-a9ff4e18b029 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1575 microversion: 2.1 time: 0.196523 Feb 04 18:09:26.756531 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 494/978] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:26 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1575 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:27.778663 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-f0f2eab9-4eac-49ec-8bc7-0fb32de570ab tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:27.779318 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-f0f2eab9-4eac-49ec-8bc7-0fb32de570ab tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:27.785661 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f0f2eab9-4eac-49ec-8bc7-0fb32de570ab tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:27.786108 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f0f2eab9-4eac-49ec-8bc7-0fb32de570ab tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:27.786934 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f0f2eab9-4eac-49ec-8bc7-0fb32de570ab tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:27.787376 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f0f2eab9-4eac-49ec-8bc7-0fb32de570ab tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:27.936492 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-f0f2eab9-4eac-49ec-8bc7-0fb32de570ab tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:27.949291 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-f0f2eab9-4eac-49ec-8bc7-0fb32de570ab tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1575 microversion: 2.1 time: 0.173913 Feb 04 18:09:27.950244 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 485/979] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:27 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:09:28.975678 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-999d3e3e-e94f-4e62-9204-d1e4660de90b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:28.980113 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-999d3e3e-e94f-4e62-9204-d1e4660de90b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:28.984516 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-999d3e3e-e94f-4e62-9204-d1e4660de90b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:28.984983 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-999d3e3e-e94f-4e62-9204-d1e4660de90b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:28.985818 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-999d3e3e-e94f-4e62-9204-d1e4660de90b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:28.986265 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-999d3e3e-e94f-4e62-9204-d1e4660de90b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:29.161166 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-999d3e3e-e94f-4e62-9204-d1e4660de90b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:29.169441 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-999d3e3e-e94f-4e62-9204-d1e4660de90b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1575 microversion: 2.1 time: 0.197773 Feb 04 18:09:29.170075 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 495/980] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:28 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1575 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:09:30.187008 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-609e0f7b-fea2-4d3f-bd4f-783a8dc9561c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:30.188042 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-609e0f7b-fea2-4d3f-bd4f-783a8dc9561c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:30.195923 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-609e0f7b-fea2-4d3f-bd4f-783a8dc9561c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:30.197070 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-609e0f7b-fea2-4d3f-bd4f-783a8dc9561c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:30.198098 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-609e0f7b-fea2-4d3f-bd4f-783a8dc9561c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:30.198795 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-609e0f7b-fea2-4d3f-bd4f-783a8dc9561c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:30.407259 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-609e0f7b-fea2-4d3f-bd4f-783a8dc9561c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:30.416482 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-609e0f7b-fea2-4d3f-bd4f-783a8dc9561c tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1575 microversion: 2.1 time: 0.233339 Feb 04 18:09:30.417072 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 486/981] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:30 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1575 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:31.369536 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-3657f712-3746-457d-ba57-a2b043303c25 req-22b34a1b-3bb0-4411-a8ec-4e3352303385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c4e346-86a3-4ecf-b0a8-5de2dced1ef1", "name": "network-vif-plugged", "status": "completed", "tag": "a8ca804a-2879-4f45-91f3-f7ace366691d"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:09:31.371187 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:09:31.371187 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:09:31.379186 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-3657f712-3746-457d-ba57-a2b043303c25 req-22b34a1b-3bb0-4411-a8ec-4e3352303385 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:31.379632 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-3657f712-3746-457d-ba57-a2b043303c25 req-22b34a1b-3bb0-4411-a8ec-4e3352303385 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:31.391418 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-3657f712-3746-457d-ba57-a2b043303c25 req-22b34a1b-3bb0-4411-a8ec-4e3352303385 service nova] Creating event network-vif-plugged:a8ca804a-2879-4f45-91f3-f7ace366691d for instance 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 on hv-cinder-82276 Feb 04 18:09:31.398239 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-3657f712-3746-457d-ba57-a2b043303c25 req-22b34a1b-3bb0-4411-a8ec-4e3352303385 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030896 Feb 04 18:09:31.398239 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 496/982] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:09:31.434897 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-4a25542c-a15a-4bd1-a6e6-38fa0d24b849 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:31.435487 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-4a25542c-a15a-4bd1-a6e6-38fa0d24b849 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:31.442484 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4a25542c-a15a-4bd1-a6e6-38fa0d24b849 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:31.442939 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4a25542c-a15a-4bd1-a6e6-38fa0d24b849 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:31.443755 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4a25542c-a15a-4bd1-a6e6-38fa0d24b849 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:31.444205 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4a25542c-a15a-4bd1-a6e6-38fa0d24b849 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:31.628426 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-4a25542c-a15a-4bd1-a6e6-38fa0d24b849 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:31.637181 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-4a25542c-a15a-4bd1-a6e6-38fa0d24b849 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1575 microversion: 2.1 time: 0.206146 Feb 04 18:09:31.637782 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 487/983] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:31 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1575 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:32.657887 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-3f8a6054-3380-4709-9875-d29e35ca56b3 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:32.658652 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-3f8a6054-3380-4709-9875-d29e35ca56b3 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:32.666099 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3f8a6054-3380-4709-9875-d29e35ca56b3 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:32.666583 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3f8a6054-3380-4709-9875-d29e35ca56b3 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:32.667424 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3f8a6054-3380-4709-9875-d29e35ca56b3 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:32.667871 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3f8a6054-3380-4709-9875-d29e35ca56b3 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:32.816876 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-3f8a6054-3380-4709-9875-d29e35ca56b3 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:32.825820 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-3f8a6054-3380-4709-9875-d29e35ca56b3 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1575 microversion: 2.1 time: 0.172564 Feb 04 18:09:32.826457 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 497/984] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:32 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:09:33.842780 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-adcb9e3d-2c70-40ee-b42f-5689a9a179dc tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:33.843451 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-adcb9e3d-2c70-40ee-b42f-5689a9a179dc tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:33.850465 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-adcb9e3d-2c70-40ee-b42f-5689a9a179dc tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:33.850910 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-adcb9e3d-2c70-40ee-b42f-5689a9a179dc tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:33.851739 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-adcb9e3d-2c70-40ee-b42f-5689a9a179dc tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:33.852184 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-adcb9e3d-2c70-40ee-b42f-5689a9a179dc tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:33.998700 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-adcb9e3d-2c70-40ee-b42f-5689a9a179dc tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:34.006234 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-adcb9e3d-2c70-40ee-b42f-5689a9a179dc tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1562 microversion: 2.1 time: 0.167430 Feb 04 18:09:34.006837 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 488/985] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:33 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:58.017595 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-0f62b800-d7cb-4b3d-961e-89051a36b3ab tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:09:58.018566 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-0f62b800-d7cb-4b3d-961e-89051a36b3ab tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:58.025106 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0f62b800-d7cb-4b3d-961e-89051a36b3ab tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:58.025549 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0f62b800-d7cb-4b3d-961e-89051a36b3ab tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:58.026323 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0f62b800-d7cb-4b3d-961e-89051a36b3ab tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:58.026801 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0f62b800-d7cb-4b3d-961e-89051a36b3ab tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:58.280452 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-0f62b800-d7cb-4b3d-961e-89051a36b3ab tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "POST /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe/action" status: 202 len: 0 microversion: 2.1 time: 0.266254 Feb 04 18:09:58.281329 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 498/986] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Feb 4 18:09:58 2022] POST /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 04 18:09:58.294688 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-85a806f0-f6b8-4180-9556-7512878287d2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:58.296788 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-85a806f0-f6b8-4180-9556-7512878287d2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:58.306265 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-85a806f0-f6b8-4180-9556-7512878287d2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:58.306866 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-85a806f0-f6b8-4180-9556-7512878287d2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:58.307774 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-85a806f0-f6b8-4180-9556-7512878287d2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:58.308362 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-85a806f0-f6b8-4180-9556-7512878287d2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:58.467567 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-85a806f0-f6b8-4180-9556-7512878287d2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:58.476765 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-85a806f0-f6b8-4180-9556-7512878287d2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1748 microversion: 2.1 time: 0.190634 Feb 04 18:09:58.477957 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 489/987] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:58 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1748 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:09:59.497886 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-9d188c18-6340-4227-89ef-5124dedbda8e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:09:59.498638 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-9d188c18-6340-4227-89ef-5124dedbda8e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:09:59.505379 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9d188c18-6340-4227-89ef-5124dedbda8e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:59.505840 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9d188c18-6340-4227-89ef-5124dedbda8e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:59.506707 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9d188c18-6340-4227-89ef-5124dedbda8e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:09:59.507158 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9d188c18-6340-4227-89ef-5124dedbda8e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:09:59.686509 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-9d188c18-6340-4227-89ef-5124dedbda8e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:09:59.696534 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-9d188c18-6340-4227-89ef-5124dedbda8e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1753 microversion: 2.1 time: 0.202923 Feb 04 18:09:59.697138 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 499/988] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:09:59 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1753 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:10:00.721993 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-d9ced2f4-9e9c-4a14-b7e5-548a4f073ae0 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:00.722611 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-d9ced2f4-9e9c-4a14-b7e5-548a4f073ae0 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:00.729271 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d9ced2f4-9e9c-4a14-b7e5-548a4f073ae0 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:00.729729 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d9ced2f4-9e9c-4a14-b7e5-548a4f073ae0 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:00.730565 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d9ced2f4-9e9c-4a14-b7e5-548a4f073ae0 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:00.731013 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d9ced2f4-9e9c-4a14-b7e5-548a4f073ae0 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:00.881601 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-d9ced2f4-9e9c-4a14-b7e5-548a4f073ae0 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:00.890224 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-d9ced2f4-9e9c-4a14-b7e5-548a4f073ae0 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1753 microversion: 2.1 time: 0.171844 Feb 04 18:10:00.890844 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 490/989] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:10:00 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:10:01.907489 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-6f44c138-98b8-404d-a1c4-770cb3159534 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:01.908096 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-6f44c138-98b8-404d-a1c4-770cb3159534 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:01.915738 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6f44c138-98b8-404d-a1c4-770cb3159534 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:01.916121 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6f44c138-98b8-404d-a1c4-770cb3159534 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:01.916958 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6f44c138-98b8-404d-a1c4-770cb3159534 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:01.917381 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6f44c138-98b8-404d-a1c4-770cb3159534 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:02.077846 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-6f44c138-98b8-404d-a1c4-770cb3159534 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:02.086609 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-6f44c138-98b8-404d-a1c4-770cb3159534 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1753 microversion: 2.1 time: 0.182751 Feb 04 18:10:02.087831 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 500/990] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:10:01 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:10:03.108258 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-774aae1f-da72-42e2-bef0-f4c4cad36eec tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:03.108890 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-774aae1f-da72-42e2-bef0-f4c4cad36eec tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:03.116049 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-774aae1f-da72-42e2-bef0-f4c4cad36eec tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:03.116507 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-774aae1f-da72-42e2-bef0-f4c4cad36eec tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:03.117346 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-774aae1f-da72-42e2-bef0-f4c4cad36eec tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:03.117796 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-774aae1f-da72-42e2-bef0-f4c4cad36eec tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:03.278825 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-774aae1f-da72-42e2-bef0-f4c4cad36eec tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:03.286729 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-774aae1f-da72-42e2-bef0-f4c4cad36eec tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1753 microversion: 2.1 time: 0.182795 Feb 04 18:10:03.287304 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 491/991] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:10:03 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1753 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:10:04.304040 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b9c93d47-c057-4f72-8108-d8a4064e41b0 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:04.304650 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-b9c93d47-c057-4f72-8108-d8a4064e41b0 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:04.311606 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b9c93d47-c057-4f72-8108-d8a4064e41b0 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:04.318046 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b9c93d47-c057-4f72-8108-d8a4064e41b0 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:04.318046 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b9c93d47-c057-4f72-8108-d8a4064e41b0 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:04.318046 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b9c93d47-c057-4f72-8108-d8a4064e41b0 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:04.462300 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-b9c93d47-c057-4f72-8108-d8a4064e41b0 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:04.471280 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-b9c93d47-c057-4f72-8108-d8a4064e41b0 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1753 microversion: 2.1 time: 0.170282 Feb 04 18:10:04.472356 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 501/992] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:10:04 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:10:05.490948 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-17d2898e-cac0-4b21-b173-eaef7853c3c7 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:05.491579 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-17d2898e-cac0-4b21-b173-eaef7853c3c7 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:05.498468 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-17d2898e-cac0-4b21-b173-eaef7853c3c7 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:05.498919 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-17d2898e-cac0-4b21-b173-eaef7853c3c7 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:05.499721 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-17d2898e-cac0-4b21-b173-eaef7853c3c7 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:05.500153 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-17d2898e-cac0-4b21-b173-eaef7853c3c7 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:05.668421 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-17d2898e-cac0-4b21-b173-eaef7853c3c7 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:05.676417 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-17d2898e-cac0-4b21-b173-eaef7853c3c7 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1753 microversion: 2.1 time: 0.189538 Feb 04 18:10:05.677001 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 492/993] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:10:05 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1753 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:10:06.693695 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-8452dae8-dbb1-4381-baf0-be0cb8353f89 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:06.694223 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-8452dae8-dbb1-4381-baf0-be0cb8353f89 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:06.700974 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8452dae8-dbb1-4381-baf0-be0cb8353f89 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:06.701422 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8452dae8-dbb1-4381-baf0-be0cb8353f89 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:06.702181 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8452dae8-dbb1-4381-baf0-be0cb8353f89 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:06.702641 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8452dae8-dbb1-4381-baf0-be0cb8353f89 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:06.848613 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-8452dae8-dbb1-4381-baf0-be0cb8353f89 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:06.856345 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-8452dae8-dbb1-4381-baf0-be0cb8353f89 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1753 microversion: 2.1 time: 0.166453 Feb 04 18:10:06.856909 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 502/994] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:10:06 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:10:07.875225 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-7f5eafaa-1e67-4631-81b9-346e6d45a042 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:07.875851 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-7f5eafaa-1e67-4631-81b9-346e6d45a042 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:07.882150 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7f5eafaa-1e67-4631-81b9-346e6d45a042 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:07.882625 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7f5eafaa-1e67-4631-81b9-346e6d45a042 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:07.884030 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7f5eafaa-1e67-4631-81b9-346e6d45a042 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:07.884469 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7f5eafaa-1e67-4631-81b9-346e6d45a042 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:08.032851 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-7f5eafaa-1e67-4631-81b9-346e6d45a042 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:08.041283 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-7f5eafaa-1e67-4631-81b9-346e6d45a042 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1753 microversion: 2.1 time: 0.170691 Feb 04 18:10:08.041859 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 493/995] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:10:07 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:10:09.058779 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-5fcd4dbd-218a-4d37-9ac2-fdabcec79780 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:09.059391 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-5fcd4dbd-218a-4d37-9ac2-fdabcec79780 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:09.066126 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5fcd4dbd-218a-4d37-9ac2-fdabcec79780 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:09.067048 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5fcd4dbd-218a-4d37-9ac2-fdabcec79780 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:09.067817 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5fcd4dbd-218a-4d37-9ac2-fdabcec79780 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:09.068249 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5fcd4dbd-218a-4d37-9ac2-fdabcec79780 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:09.215704 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-5fcd4dbd-218a-4d37-9ac2-fdabcec79780 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:09.223568 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-5fcd4dbd-218a-4d37-9ac2-fdabcec79780 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1753 microversion: 2.1 time: 0.169154 Feb 04 18:10:09.224146 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 503/996] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:10:09 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:10:10.241202 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-92f86ae8-09b7-4dc4-a5a5-c51bdabccd5e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:10.241847 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-92f86ae8-09b7-4dc4-a5a5-c51bdabccd5e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:10.248274 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-92f86ae8-09b7-4dc4-a5a5-c51bdabccd5e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:10.248726 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-92f86ae8-09b7-4dc4-a5a5-c51bdabccd5e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:10.249516 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-92f86ae8-09b7-4dc4-a5a5-c51bdabccd5e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:10.249960 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-92f86ae8-09b7-4dc4-a5a5-c51bdabccd5e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:10.396626 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-92f86ae8-09b7-4dc4-a5a5-c51bdabccd5e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:10.404621 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-92f86ae8-09b7-4dc4-a5a5-c51bdabccd5e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1753 microversion: 2.1 time: 0.167399 Feb 04 18:10:10.405190 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 494/997] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:10:10 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:10:11.421503 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-41833ab5-fa5f-4b03-8e6b-c71be8d60557 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:11.422033 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-41833ab5-fa5f-4b03-8e6b-c71be8d60557 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:11.428210 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-41833ab5-fa5f-4b03-8e6b-c71be8d60557 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:11.428683 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-41833ab5-fa5f-4b03-8e6b-c71be8d60557 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:11.429443 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-41833ab5-fa5f-4b03-8e6b-c71be8d60557 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:11.429870 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-41833ab5-fa5f-4b03-8e6b-c71be8d60557 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:11.576147 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-41833ab5-fa5f-4b03-8e6b-c71be8d60557 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:11.583980 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-41833ab5-fa5f-4b03-8e6b-c71be8d60557 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1753 microversion: 2.1 time: 0.166182 Feb 04 18:10:11.584552 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 504/998] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:10:11 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:10:12.601366 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b1265e8f-5541-4745-821f-6dcb366c24ed tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:12.602526 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-b1265e8f-5541-4745-821f-6dcb366c24ed tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:12.608975 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b1265e8f-5541-4745-821f-6dcb366c24ed tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:12.609431 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b1265e8f-5541-4745-821f-6dcb366c24ed tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:12.610226 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b1265e8f-5541-4745-821f-6dcb366c24ed tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:12.610709 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b1265e8f-5541-4745-821f-6dcb366c24ed tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:12.755764 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-b1265e8f-5541-4745-821f-6dcb366c24ed tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:12.764657 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b1265e8f-5541-4745-821f-6dcb366c24ed tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1753 microversion: 2.1 time: 0.166953 Feb 04 18:10:12.765234 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 495/999] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:10:12 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:10:13.781707 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-77830f34-26e5-45d4-b769-442c16e62fe2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:13.782311 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-77830f34-26e5-45d4-b769-442c16e62fe2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:13.788509 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-77830f34-26e5-45d4-b769-442c16e62fe2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:13.788955 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-77830f34-26e5-45d4-b769-442c16e62fe2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:13.789761 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-77830f34-26e5-45d4-b769-442c16e62fe2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:13.790196 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-77830f34-26e5-45d4-b769-442c16e62fe2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:13.932701 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-77830f34-26e5-45d4-b769-442c16e62fe2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:13.940459 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-77830f34-26e5-45d4-b769-442c16e62fe2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1753 microversion: 2.1 time: 0.162448 Feb 04 18:10:13.941036 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 505/1000] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:10:13 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:10:14.957247 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-497593d4-ebbf-410c-ae5f-7a7e91caf2e1 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:14.957887 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-497593d4-ebbf-410c-ae5f-7a7e91caf2e1 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:14.965029 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-497593d4-ebbf-410c-ae5f-7a7e91caf2e1 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:14.965515 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-497593d4-ebbf-410c-ae5f-7a7e91caf2e1 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:14.966544 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-497593d4-ebbf-410c-ae5f-7a7e91caf2e1 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:14.967023 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-497593d4-ebbf-410c-ae5f-7a7e91caf2e1 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:15.129628 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-497593d4-ebbf-410c-ae5f-7a7e91caf2e1 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:15.138913 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-497593d4-ebbf-410c-ae5f-7a7e91caf2e1 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1753 microversion: 2.1 time: 0.185277 Feb 04 18:10:15.139738 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 496/1001] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:10:14 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1753 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:10:16.155904 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-19b5a9db-d988-4927-a941-d36b094a7743 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:16.156529 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-19b5a9db-d988-4927-a941-d36b094a7743 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:16.162898 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-19b5a9db-d988-4927-a941-d36b094a7743 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:16.163347 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-19b5a9db-d988-4927-a941-d36b094a7743 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:16.164120 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-19b5a9db-d988-4927-a941-d36b094a7743 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:16.165074 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-19b5a9db-d988-4927-a941-d36b094a7743 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:16.305863 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-19b5a9db-d988-4927-a941-d36b094a7743 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:16.313688 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-19b5a9db-d988-4927-a941-d36b094a7743 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1756 microversion: 2.1 time: 0.161465 Feb 04 18:10:16.321788 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 506/1002] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:10:16 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:10:43.155975 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-4d844acf-10d4-4099-9de9-d198a9e1e7b3 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:43.156482 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-4d844acf-10d4-4099-9de9-d198a9e1e7b3 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:43.162244 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4d844acf-10d4-4099-9de9-d198a9e1e7b3 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:43.162744 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4d844acf-10d4-4099-9de9-d198a9e1e7b3 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:43.163521 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4d844acf-10d4-4099-9de9-d198a9e1e7b3 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:43.164521 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4d844acf-10d4-4099-9de9-d198a9e1e7b3 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:43.240565 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.objects.instance [None req-4d844acf-10d4-4099-9de9-d198a9e1e7b3 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lazy-loading 'services' on Instance uuid 629aebef-875d-4e7d-b9e6-ab8e0195d62c {{(pid=123567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:10:43.418840 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-4d844acf-10d4-4099-9de9-d198a9e1e7b3 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "DELETE /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c/os-volume_attachments/bf4e173b-28f9-45de-9e75-0b48de5ac590" status: 202 len: 0 microversion: 2.1 time: 0.367219 Feb 04 18:10:43.419477 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 497/1003] 10.222.0.98 () {58 vars in 1415 bytes} [Fri Feb 4 18:10:43 2022] DELETE /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c/os-volume_attachments/bf4e173b-28f9-45de-9e75-0b48de5ac590 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 04 18:10:45.572836 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b4481846-96b0-4139-98b5-b4df0f436145 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:10:45.578959 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b4481846-96b0-4139-98b5-b4df0f436145 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:45.579415 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b4481846-96b0-4139-98b5-b4df0f436145 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:45.600607 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-b4481846-96b0-4139-98b5-b4df0f436145 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Going to try to stop instance {{(pid=123566) force_stop /opt/stack/nova/nova/compute/api.py:2655}} Feb 04 18:10:45.799144 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-b4481846-96b0-4139-98b5-b4df0f436145 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "POST /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c/action" status: 202 len: 0 microversion: 2.1 time: 0.229706 Feb 04 18:10:45.799688 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 507/1004] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Feb 4 18:10:45 2022] POST /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 04 18:10:45.809202 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a8e540ca-8c4b-4505-979c-cf368f09846d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:45.809936 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-a8e540ca-8c4b-4505-979c-cf368f09846d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:45.816086 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a8e540ca-8c4b-4505-979c-cf368f09846d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:45.816543 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a8e540ca-8c4b-4505-979c-cf368f09846d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:45.817335 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a8e540ca-8c4b-4505-979c-cf368f09846d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:45.817811 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a8e540ca-8c4b-4505-979c-cf368f09846d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:46.005825 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-a8e540ca-8c4b-4505-979c-cf368f09846d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:46.013341 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a8e540ca-8c4b-4505-979c-cf368f09846d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1677 microversion: 2.1 time: 0.209257 Feb 04 18:10:46.013913 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 498/1005] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:10:45 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1677 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:10:47.032876 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-9ae09ae2-b16c-497c-a601-98e982e3ccdc tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:47.033576 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-9ae09ae2-b16c-497c-a601-98e982e3ccdc tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:47.039788 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9ae09ae2-b16c-497c-a601-98e982e3ccdc tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:47.040246 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9ae09ae2-b16c-497c-a601-98e982e3ccdc tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:47.041030 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9ae09ae2-b16c-497c-a601-98e982e3ccdc tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:47.041475 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9ae09ae2-b16c-497c-a601-98e982e3ccdc tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:47.223540 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-9ae09ae2-b16c-497c-a601-98e982e3ccdc tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:47.231326 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-9ae09ae2-b16c-497c-a601-98e982e3ccdc tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1677 microversion: 2.1 time: 0.202958 Feb 04 18:10:47.231897 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 508/1006] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:10:47 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1677 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:10:48.248698 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-36dccea0-fe4d-4d19-8168-b036049fc922 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:48.249318 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-36dccea0-fe4d-4d19-8168-b036049fc922 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:48.255700 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-36dccea0-fe4d-4d19-8168-b036049fc922 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:48.256157 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-36dccea0-fe4d-4d19-8168-b036049fc922 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:48.256955 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-36dccea0-fe4d-4d19-8168-b036049fc922 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:48.257414 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-36dccea0-fe4d-4d19-8168-b036049fc922 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:48.396786 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-36dccea0-fe4d-4d19-8168-b036049fc922 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:48.403498 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-36dccea0-fe4d-4d19-8168-b036049fc922 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1677 microversion: 2.1 time: 0.158488 Feb 04 18:10:48.404067 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 499/1007] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:10:48 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:10:49.420727 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-6fca8dd2-dc74-4971-84c9-5ec873295183 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:49.421288 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-6fca8dd2-dc74-4971-84c9-5ec873295183 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:49.427360 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6fca8dd2-dc74-4971-84c9-5ec873295183 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:49.427837 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6fca8dd2-dc74-4971-84c9-5ec873295183 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:49.428621 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6fca8dd2-dc74-4971-84c9-5ec873295183 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:49.429059 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6fca8dd2-dc74-4971-84c9-5ec873295183 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:49.565586 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-6fca8dd2-dc74-4971-84c9-5ec873295183 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:49.574078 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-6fca8dd2-dc74-4971-84c9-5ec873295183 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1677 microversion: 2.1 time: 0.157094 Feb 04 18:10:49.574702 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 509/1008] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:10:49 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:10:50.591733 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-7267aa82-0cea-4e97-888b-4d71163d70c8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:50.592346 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-7267aa82-0cea-4e97-888b-4d71163d70c8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:50.598272 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7267aa82-0cea-4e97-888b-4d71163d70c8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:50.598761 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7267aa82-0cea-4e97-888b-4d71163d70c8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:50.599558 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7267aa82-0cea-4e97-888b-4d71163d70c8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:50.600002 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7267aa82-0cea-4e97-888b-4d71163d70c8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:50.731728 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-7267aa82-0cea-4e97-888b-4d71163d70c8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:50.739340 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-7267aa82-0cea-4e97-888b-4d71163d70c8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1677 microversion: 2.1 time: 0.151467 Feb 04 18:10:50.739925 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 500/1009] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:10:50 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:10:51.756211 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-a2f9c7d4-6202-4780-9878-87d8af87a7d5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:51.756822 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-a2f9c7d4-6202-4780-9878-87d8af87a7d5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:51.763760 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a2f9c7d4-6202-4780-9878-87d8af87a7d5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:51.764210 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a2f9c7d4-6202-4780-9878-87d8af87a7d5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:51.765018 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a2f9c7d4-6202-4780-9878-87d8af87a7d5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:51.765460 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a2f9c7d4-6202-4780-9878-87d8af87a7d5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:51.905532 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-a2f9c7d4-6202-4780-9878-87d8af87a7d5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:51.913231 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-a2f9c7d4-6202-4780-9878-87d8af87a7d5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1677 microversion: 2.1 time: 0.160576 Feb 04 18:10:51.913874 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 510/1010] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:10:51 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:10:52.931118 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-939870de-ec79-46cc-aab5-540f3aac0518 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:52.931766 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-939870de-ec79-46cc-aab5-540f3aac0518 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:52.938252 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-939870de-ec79-46cc-aab5-540f3aac0518 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:52.938746 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-939870de-ec79-46cc-aab5-540f3aac0518 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:52.939567 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-939870de-ec79-46cc-aab5-540f3aac0518 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:52.940010 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-939870de-ec79-46cc-aab5-540f3aac0518 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:53.072873 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-939870de-ec79-46cc-aab5-540f3aac0518 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:53.080233 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-939870de-ec79-46cc-aab5-540f3aac0518 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1677 microversion: 2.1 time: 0.153441 Feb 04 18:10:53.082301 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 501/1011] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:10:52 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:10:54.096940 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-774e6be5-85ee-47d3-bdb4-ea6e8e638fe0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:54.097553 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-774e6be5-85ee-47d3-bdb4-ea6e8e638fe0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:54.104496 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-774e6be5-85ee-47d3-bdb4-ea6e8e638fe0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:54.104944 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-774e6be5-85ee-47d3-bdb4-ea6e8e638fe0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:54.105726 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-774e6be5-85ee-47d3-bdb4-ea6e8e638fe0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:54.106162 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-774e6be5-85ee-47d3-bdb4-ea6e8e638fe0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:54.242192 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-774e6be5-85ee-47d3-bdb4-ea6e8e638fe0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:54.249645 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-774e6be5-85ee-47d3-bdb4-ea6e8e638fe0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1677 microversion: 2.1 time: 0.156315 Feb 04 18:10:54.250212 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 511/1012] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:10:54 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:10:55.266379 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-4f585448-2177-460b-9f72-6159caacb5d5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:55.267020 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-4f585448-2177-460b-9f72-6159caacb5d5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:55.273364 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4f585448-2177-460b-9f72-6159caacb5d5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:55.273820 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4f585448-2177-460b-9f72-6159caacb5d5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:55.274658 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4f585448-2177-460b-9f72-6159caacb5d5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:55.275097 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4f585448-2177-460b-9f72-6159caacb5d5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:55.409683 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-4f585448-2177-460b-9f72-6159caacb5d5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:55.417688 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-4f585448-2177-460b-9f72-6159caacb5d5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1677 microversion: 2.1 time: 0.154994 Feb 04 18:10:55.418268 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 502/1013] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:10:55 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:10:55.817975 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-15272127-9158-4dc5-8028-a613cf464d19 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:10:55.818570 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-15272127-9158-4dc5-8028-a613cf464d19 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:55.824478 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-15272127-9158-4dc5-8028-a613cf464d19 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:55.824933 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-15272127-9158-4dc5-8028-a613cf464d19 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:55.825706 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-15272127-9158-4dc5-8028-a613cf464d19 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:55.826140 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-15272127-9158-4dc5-8028-a613cf464d19 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:55.848807 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.objects.instance [None req-15272127-9158-4dc5-8028-a613cf464d19 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lazy-loading 'flavor' on Instance uuid 32416d02-187d-4d8f-9698-d36ac5ffbc26 {{(pid=123566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:10:56.436076 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-92f2dd06-2adf-4388-aa0d-84d7b64372c0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:56.436694 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-92f2dd06-2adf-4388-aa0d-84d7b64372c0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:56.443744 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-92f2dd06-2adf-4388-aa0d-84d7b64372c0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:56.444332 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-92f2dd06-2adf-4388-aa0d-84d7b64372c0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:56.445811 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-92f2dd06-2adf-4388-aa0d-84d7b64372c0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:56.446258 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-92f2dd06-2adf-4388-aa0d-84d7b64372c0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:56.448486 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-15272127-9158-4dc5-8028-a613cf464d19 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "POST /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26/action" status: 202 len: 0 microversion: 2.20 time: 0.715199 Feb 04 18:10:56.449134 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 512/1014] 10.222.0.98 () {62 vars in 1318 bytes} [Fri Feb 4 18:10:55 2022] POST /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26/action => generated 0 bytes in 717 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 04 18:10:56.457855 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-22fe2bfc-f1e0-4e21-9bf2-fdad273c13b9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:56.458661 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-22fe2bfc-f1e0-4e21-9bf2-fdad273c13b9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:56.465685 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-22fe2bfc-f1e0-4e21-9bf2-fdad273c13b9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:56.465685 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-22fe2bfc-f1e0-4e21-9bf2-fdad273c13b9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:56.469769 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-22fe2bfc-f1e0-4e21-9bf2-fdad273c13b9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:56.469769 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-22fe2bfc-f1e0-4e21-9bf2-fdad273c13b9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:56.669996 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-22fe2bfc-f1e0-4e21-9bf2-fdad273c13b9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:56.675102 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-92f2dd06-2adf-4388-aa0d-84d7b64372c0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:56.680847 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-22fe2bfc-f1e0-4e21-9bf2-fdad273c13b9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:56.684053 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-22fe2bfc-f1e0-4e21-9bf2-fdad273c13b9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:56.684053 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-22fe2bfc-f1e0-4e21-9bf2-fdad273c13b9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1720 microversion: 2.20 time: 0.229970 Feb 04 18:10:56.684851 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-92f2dd06-2adf-4388-aa0d-84d7b64372c0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1677 microversion: 2.1 time: 0.251998 Feb 04 18:10:56.689587 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 513/1015] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:10:56 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1720 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:10:56.689783 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 503/1016] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:10:56 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1677 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:10:57.701375 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-efdfa613-d2f1-42e8-b541-54ff3acb0415 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:57.701984 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-efdfa613-d2f1-42e8-b541-54ff3acb0415 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:57.702656 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-0f1f2b67-158b-4233-80a6-8793f3e0cd98 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:57.703276 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-0f1f2b67-158b-4233-80a6-8793f3e0cd98 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:57.708046 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-efdfa613-d2f1-42e8-b541-54ff3acb0415 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:57.708493 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-efdfa613-d2f1-42e8-b541-54ff3acb0415 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:57.709267 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-efdfa613-d2f1-42e8-b541-54ff3acb0415 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:57.709530 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0f1f2b67-158b-4233-80a6-8793f3e0cd98 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:57.709696 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-efdfa613-d2f1-42e8-b541-54ff3acb0415 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:57.709983 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0f1f2b67-158b-4233-80a6-8793f3e0cd98 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:57.711435 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0f1f2b67-158b-4233-80a6-8793f3e0cd98 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:57.711873 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0f1f2b67-158b-4233-80a6-8793f3e0cd98 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:57.916557 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-efdfa613-d2f1-42e8-b541-54ff3acb0415 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:57.919123 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-0f1f2b67-158b-4233-80a6-8793f3e0cd98 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:57.924504 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-efdfa613-d2f1-42e8-b541-54ff3acb0415 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1654 microversion: 2.1 time: 0.226770 Feb 04 18:10:57.925188 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 514/1017] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:10:57 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1654 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:10:57.926996 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-0f1f2b67-158b-4233-80a6-8793f3e0cd98 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:57.928512 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-0f1f2b67-158b-4233-80a6-8793f3e0cd98 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:57.930176 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-0f1f2b67-158b-4233-80a6-8793f3e0cd98 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1720 microversion: 2.20 time: 0.231477 Feb 04 18:10:57.930760 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 504/1018] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:10:57 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1720 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:10:57.941633 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b6e8aeaa-df32-425b-aeb2-05623060f520 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:10:57.948167 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b6e8aeaa-df32-425b-aeb2-05623060f520 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:57.948623 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b6e8aeaa-df32-425b-aeb2-05623060f520 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:57.974659 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-b6e8aeaa-df32-425b-aeb2-05623060f520 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Going to try to start instance {{(pid=123566) start /opt/stack/nova/nova/compute/api.py:2678}} Feb 04 18:10:58.220489 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-b6e8aeaa-df32-425b-aeb2-05623060f520 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "POST /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c/action" status: 202 len: 0 microversion: 2.1 time: 0.282397 Feb 04 18:10:58.221100 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 515/1019] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Feb 4 18:10:57 2022] POST /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 04 18:10:58.229846 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-d82d8460-65e6-434c-a603-4a97ebfbae71 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:58.237420 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-d82d8460-65e6-434c-a603-4a97ebfbae71 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:58.237420 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d82d8460-65e6-434c-a603-4a97ebfbae71 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:58.237420 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d82d8460-65e6-434c-a603-4a97ebfbae71 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:58.237789 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d82d8460-65e6-434c-a603-4a97ebfbae71 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:58.238109 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d82d8460-65e6-434c-a603-4a97ebfbae71 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:58.383263 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-d82d8460-65e6-434c-a603-4a97ebfbae71 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:58.391218 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-d82d8460-65e6-434c-a603-4a97ebfbae71 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1663 microversion: 2.1 time: 0.165689 Feb 04 18:10:58.392323 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 505/1020] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:10:58 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1663 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:10:58.949992 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-1e581fd5-0daf-4d8b-a895-ebf20fb4c299 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:58.950713 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-1e581fd5-0daf-4d8b-a895-ebf20fb4c299 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:58.956904 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1e581fd5-0daf-4d8b-a895-ebf20fb4c299 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:58.957347 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1e581fd5-0daf-4d8b-a895-ebf20fb4c299 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:58.958134 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1e581fd5-0daf-4d8b-a895-ebf20fb4c299 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:58.958697 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1e581fd5-0daf-4d8b-a895-ebf20fb4c299 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:59.104812 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-1e581fd5-0daf-4d8b-a895-ebf20fb4c299 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:59.112767 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-1e581fd5-0daf-4d8b-a895-ebf20fb4c299 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:59.115626 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-1e581fd5-0daf-4d8b-a895-ebf20fb4c299 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:59.115788 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-1e581fd5-0daf-4d8b-a895-ebf20fb4c299 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1720 microversion: 2.20 time: 0.170860 Feb 04 18:10:59.116263 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 516/1021] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:10:58 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:10:59.408790 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-9e6f93f7-44c7-4732-8cb3-b9fe2ce34be2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:10:59.409344 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-9e6f93f7-44c7-4732-8cb3-b9fe2ce34be2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:10:59.415915 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9e6f93f7-44c7-4732-8cb3-b9fe2ce34be2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:59.416364 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9e6f93f7-44c7-4732-8cb3-b9fe2ce34be2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:59.417148 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9e6f93f7-44c7-4732-8cb3-b9fe2ce34be2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:10:59.417585 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-9e6f93f7-44c7-4732-8cb3-b9fe2ce34be2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:10:59.551876 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-9e6f93f7-44c7-4732-8cb3-b9fe2ce34be2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:10:59.559942 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-9e6f93f7-44c7-4732-8cb3-b9fe2ce34be2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1663 microversion: 2.1 time: 0.155055 Feb 04 18:10:59.560517 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 506/1022] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:10:59 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:11:00.134625 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-2a3d1466-caf0-40d9-a873-64b3eb273f92 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:00.135403 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-2a3d1466-caf0-40d9-a873-64b3eb273f92 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:00.142490 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2a3d1466-caf0-40d9-a873-64b3eb273f92 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:00.142973 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2a3d1466-caf0-40d9-a873-64b3eb273f92 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:00.144567 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2a3d1466-caf0-40d9-a873-64b3eb273f92 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:00.144567 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2a3d1466-caf0-40d9-a873-64b3eb273f92 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:00.291643 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2a3d1466-caf0-40d9-a873-64b3eb273f92 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:00.300091 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2a3d1466-caf0-40d9-a873-64b3eb273f92 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:00.301587 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2a3d1466-caf0-40d9-a873-64b3eb273f92 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:00.302775 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-2a3d1466-caf0-40d9-a873-64b3eb273f92 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1720 microversion: 2.20 time: 0.172421 Feb 04 18:11:00.303335 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 517/1023] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:00 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:00.576487 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b20ffeb1-4454-400b-9c40-6d21d23036c1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:00.577096 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-b20ffeb1-4454-400b-9c40-6d21d23036c1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:00.583430 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b20ffeb1-4454-400b-9c40-6d21d23036c1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:00.583882 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b20ffeb1-4454-400b-9c40-6d21d23036c1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:00.584668 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b20ffeb1-4454-400b-9c40-6d21d23036c1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:00.585110 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b20ffeb1-4454-400b-9c40-6d21d23036c1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:00.718326 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-b20ffeb1-4454-400b-9c40-6d21d23036c1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:00.725844 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b20ffeb1-4454-400b-9c40-6d21d23036c1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1667 microversion: 2.1 time: 0.153010 Feb 04 18:11:00.726439 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 507/1024] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:11:00 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:11:01.321185 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-7fe83014-a2cd-4679-bd84-cc8719d9c63d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:01.321788 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-7fe83014-a2cd-4679-bd84-cc8719d9c63d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:01.328207 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7fe83014-a2cd-4679-bd84-cc8719d9c63d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:01.328653 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7fe83014-a2cd-4679-bd84-cc8719d9c63d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:01.329412 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7fe83014-a2cd-4679-bd84-cc8719d9c63d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:01.329841 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7fe83014-a2cd-4679-bd84-cc8719d9c63d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:01.460861 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-7fe83014-a2cd-4679-bd84-cc8719d9c63d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:01.468760 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-7fe83014-a2cd-4679-bd84-cc8719d9c63d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:01.470241 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-7fe83014-a2cd-4679-bd84-cc8719d9c63d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:01.471424 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-7fe83014-a2cd-4679-bd84-cc8719d9c63d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1720 microversion: 2.20 time: 0.153967 Feb 04 18:11:01.471982 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 518/1025] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:01 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:02.489353 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c0ce7103-dbb7-4aab-81b2-0cfb093828f2 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:02.490062 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c0ce7103-dbb7-4aab-81b2-0cfb093828f2 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:02.496952 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c0ce7103-dbb7-4aab-81b2-0cfb093828f2 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:02.497410 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c0ce7103-dbb7-4aab-81b2-0cfb093828f2 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:02.498196 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c0ce7103-dbb7-4aab-81b2-0cfb093828f2 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:02.498668 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c0ce7103-dbb7-4aab-81b2-0cfb093828f2 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:02.633752 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c0ce7103-dbb7-4aab-81b2-0cfb093828f2 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:02.641598 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c0ce7103-dbb7-4aab-81b2-0cfb093828f2 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:02.643112 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c0ce7103-dbb7-4aab-81b2-0cfb093828f2 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:02.644268 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c0ce7103-dbb7-4aab-81b2-0cfb093828f2 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1720 microversion: 2.20 time: 0.158917 Feb 04 18:11:02.644818 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 508/1026] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:02 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:03.662322 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-f1b6b608-5ad6-417f-92b6-91c0b937a6bb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:03.662963 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-f1b6b608-5ad6-417f-92b6-91c0b937a6bb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:03.669762 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f1b6b608-5ad6-417f-92b6-91c0b937a6bb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:03.670204 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f1b6b608-5ad6-417f-92b6-91c0b937a6bb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:03.671031 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f1b6b608-5ad6-417f-92b6-91c0b937a6bb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:03.671461 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f1b6b608-5ad6-417f-92b6-91c0b937a6bb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:03.804606 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-f1b6b608-5ad6-417f-92b6-91c0b937a6bb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:03.812523 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-f1b6b608-5ad6-417f-92b6-91c0b937a6bb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:03.814015 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-f1b6b608-5ad6-417f-92b6-91c0b937a6bb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:03.815197 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-f1b6b608-5ad6-417f-92b6-91c0b937a6bb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1720 microversion: 2.20 time: 0.156639 Feb 04 18:11:03.815762 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 519/1027] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:03 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:04.834575 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-df7d0425-1a70-40e7-8fbd-b96bb8730fb0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:04.835171 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-df7d0425-1a70-40e7-8fbd-b96bb8730fb0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:04.841599 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-df7d0425-1a70-40e7-8fbd-b96bb8730fb0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:04.842050 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-df7d0425-1a70-40e7-8fbd-b96bb8730fb0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:04.842857 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-df7d0425-1a70-40e7-8fbd-b96bb8730fb0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:04.843298 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-df7d0425-1a70-40e7-8fbd-b96bb8730fb0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:04.979010 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-df7d0425-1a70-40e7-8fbd-b96bb8730fb0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:04.986840 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-df7d0425-1a70-40e7-8fbd-b96bb8730fb0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:04.988591 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-df7d0425-1a70-40e7-8fbd-b96bb8730fb0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:04.989766 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-df7d0425-1a70-40e7-8fbd-b96bb8730fb0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1720 microversion: 2.20 time: 0.159317 Feb 04 18:11:04.990328 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 509/1028] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:04 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:11:06.009036 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-c024a8d3-29a5-4ae0-bfa6-72f6773c108b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:06.009633 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-c024a8d3-29a5-4ae0-bfa6-72f6773c108b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:06.016114 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c024a8d3-29a5-4ae0-bfa6-72f6773c108b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:06.016560 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c024a8d3-29a5-4ae0-bfa6-72f6773c108b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:06.017371 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c024a8d3-29a5-4ae0-bfa6-72f6773c108b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:06.017833 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c024a8d3-29a5-4ae0-bfa6-72f6773c108b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:06.151869 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c024a8d3-29a5-4ae0-bfa6-72f6773c108b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:06.159708 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c024a8d3-29a5-4ae0-bfa6-72f6773c108b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:06.161203 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c024a8d3-29a5-4ae0-bfa6-72f6773c108b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:06.162356 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-c024a8d3-29a5-4ae0-bfa6-72f6773c108b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1720 microversion: 2.20 time: 0.157553 Feb 04 18:11:06.163006 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 520/1029] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:06 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:07.179977 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-494b4f05-19d5-45f0-a1a5-7215ff28a305 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:07.180627 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-494b4f05-19d5-45f0-a1a5-7215ff28a305 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:07.187096 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-494b4f05-19d5-45f0-a1a5-7215ff28a305 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:07.187641 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-494b4f05-19d5-45f0-a1a5-7215ff28a305 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:07.188428 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-494b4f05-19d5-45f0-a1a5-7215ff28a305 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:07.188870 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-494b4f05-19d5-45f0-a1a5-7215ff28a305 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:07.320005 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-494b4f05-19d5-45f0-a1a5-7215ff28a305 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:07.327948 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-494b4f05-19d5-45f0-a1a5-7215ff28a305 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:07.329461 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-494b4f05-19d5-45f0-a1a5-7215ff28a305 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:07.330663 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-494b4f05-19d5-45f0-a1a5-7215ff28a305 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1720 microversion: 2.20 time: 0.154440 Feb 04 18:11:07.331223 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 510/1030] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:07 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:08.349221 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-f778b3a6-3135-4461-afa2-fe035f19fcb5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:08.349825 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-f778b3a6-3135-4461-afa2-fe035f19fcb5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:08.356323 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f778b3a6-3135-4461-afa2-fe035f19fcb5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:08.356783 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f778b3a6-3135-4461-afa2-fe035f19fcb5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:08.357568 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f778b3a6-3135-4461-afa2-fe035f19fcb5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:08.358011 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f778b3a6-3135-4461-afa2-fe035f19fcb5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:08.505932 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-f778b3a6-3135-4461-afa2-fe035f19fcb5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:08.515011 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-f778b3a6-3135-4461-afa2-fe035f19fcb5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:08.516507 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-f778b3a6-3135-4461-afa2-fe035f19fcb5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:08.517709 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-f778b3a6-3135-4461-afa2-fe035f19fcb5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1741 microversion: 2.20 time: 0.172288 Feb 04 18:11:08.518344 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 521/1031] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:08 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1741 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:09.536474 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-22b722a8-6743-4914-ac4a-a05849f269f4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:09.537089 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-22b722a8-6743-4914-ac4a-a05849f269f4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:09.544070 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-22b722a8-6743-4914-ac4a-a05849f269f4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:09.544524 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-22b722a8-6743-4914-ac4a-a05849f269f4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:09.545309 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-22b722a8-6743-4914-ac4a-a05849f269f4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:09.545754 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-22b722a8-6743-4914-ac4a-a05849f269f4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:09.680131 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-22b722a8-6743-4914-ac4a-a05849f269f4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:09.688016 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-22b722a8-6743-4914-ac4a-a05849f269f4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:09.689510 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-22b722a8-6743-4914-ac4a-a05849f269f4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:09.690691 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-22b722a8-6743-4914-ac4a-a05849f269f4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1741 microversion: 2.20 time: 0.158051 Feb 04 18:11:09.691250 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 511/1032] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:09 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:11:10.709427 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-33c97873-b3cd-4d55-ac20-c9d294467783 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:10.710044 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-33c97873-b3cd-4d55-ac20-c9d294467783 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:10.716355 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-33c97873-b3cd-4d55-ac20-c9d294467783 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:10.716811 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-33c97873-b3cd-4d55-ac20-c9d294467783 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:10.717595 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-33c97873-b3cd-4d55-ac20-c9d294467783 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:10.718036 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-33c97873-b3cd-4d55-ac20-c9d294467783 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:10.852455 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-33c97873-b3cd-4d55-ac20-c9d294467783 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:10.860465 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-33c97873-b3cd-4d55-ac20-c9d294467783 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:10.862052 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-33c97873-b3cd-4d55-ac20-c9d294467783 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:10.863521 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-33c97873-b3cd-4d55-ac20-c9d294467783 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1741 microversion: 2.20 time: 0.157526 Feb 04 18:11:10.864080 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 522/1033] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:10 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:11.882469 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-dd3097b3-6e43-4bba-b4df-6a09e4509905 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:11.883076 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-dd3097b3-6e43-4bba-b4df-6a09e4509905 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:11.889178 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dd3097b3-6e43-4bba-b4df-6a09e4509905 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:11.889637 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dd3097b3-6e43-4bba-b4df-6a09e4509905 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:11.890485 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dd3097b3-6e43-4bba-b4df-6a09e4509905 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:11.890935 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-dd3097b3-6e43-4bba-b4df-6a09e4509905 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:11.932144 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-83816366-d071-489b-9f5b-63188735d672 req-54607fed-0bf9-4276-bc1c-39495bee1918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32416d02-187d-4d8f-9698-d36ac5ffbc26", "name": "network-vif-plugged", "status": "completed", "tag": "8dbc5ea2-225d-4915-8e59-f39e014f906a"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:11:11.933709 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:11:11.933709 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:11:11.941327 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-83816366-d071-489b-9f5b-63188735d672 req-54607fed-0bf9-4276-bc1c-39495bee1918 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:11.941838 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-83816366-d071-489b-9f5b-63188735d672 req-54607fed-0bf9-4276-bc1c-39495bee1918 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:11.953683 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-83816366-d071-489b-9f5b-63188735d672 req-54607fed-0bf9-4276-bc1c-39495bee1918 service nova] Creating event network-vif-plugged:8dbc5ea2-225d-4915-8e59-f39e014f906a for instance 32416d02-187d-4d8f-9698-d36ac5ffbc26 on hv-cinder-82276 Feb 04 18:11:11.958778 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-83816366-d071-489b-9f5b-63188735d672 req-54607fed-0bf9-4276-bc1c-39495bee1918 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030264 Feb 04 18:11:11.959426 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 523/1034] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:11:12.028474 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-dd3097b3-6e43-4bba-b4df-6a09e4509905 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:12.036319 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-dd3097b3-6e43-4bba-b4df-6a09e4509905 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:12.037832 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-dd3097b3-6e43-4bba-b4df-6a09e4509905 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:12.039031 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-dd3097b3-6e43-4bba-b4df-6a09e4509905 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1741 microversion: 2.20 time: 0.160780 Feb 04 18:11:12.039593 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 512/1035] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:11 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1741 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:11:13.057990 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-dd3a652b-1a16-4249-9fcf-db4725d9fbd1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:13.058717 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-dd3a652b-1a16-4249-9fcf-db4725d9fbd1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:13.064882 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dd3a652b-1a16-4249-9fcf-db4725d9fbd1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:13.065335 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dd3a652b-1a16-4249-9fcf-db4725d9fbd1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:13.066122 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dd3a652b-1a16-4249-9fcf-db4725d9fbd1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:13.066601 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dd3a652b-1a16-4249-9fcf-db4725d9fbd1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:13.204193 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-dd3a652b-1a16-4249-9fcf-db4725d9fbd1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:13.212786 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-dd3a652b-1a16-4249-9fcf-db4725d9fbd1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:13.214281 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-dd3a652b-1a16-4249-9fcf-db4725d9fbd1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:13.215465 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-dd3a652b-1a16-4249-9fcf-db4725d9fbd1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1741 microversion: 2.20 time: 0.161994 Feb 04 18:11:13.216021 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 524/1036] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:13 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1741 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:14.233750 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-303c0548-0010-46ef-8d8f-7371ca94b11c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:14.234364 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-303c0548-0010-46ef-8d8f-7371ca94b11c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:14.241092 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-303c0548-0010-46ef-8d8f-7371ca94b11c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:14.242079 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-303c0548-0010-46ef-8d8f-7371ca94b11c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:14.243029 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-303c0548-0010-46ef-8d8f-7371ca94b11c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:14.243474 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-303c0548-0010-46ef-8d8f-7371ca94b11c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:14.376739 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-303c0548-0010-46ef-8d8f-7371ca94b11c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:14.384594 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-303c0548-0010-46ef-8d8f-7371ca94b11c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:14.386133 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-303c0548-0010-46ef-8d8f-7371ca94b11c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:14.387325 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-303c0548-0010-46ef-8d8f-7371ca94b11c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1741 microversion: 2.20 time: 0.157441 Feb 04 18:11:14.387883 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 513/1037] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:14 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:11:15.262992 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-bd20945e-f89f-440f-a59d-823046160c45 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:15.264327 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-bd20945e-f89f-440f-a59d-823046160c45 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:15.264585 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-8db82456-597e-42e6-94a1-b30d76997539 req-051b08fb-8ffc-404d-842d-58c9a8054259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78c4e346-86a3-4ecf-b0a8-5de2dced1ef1", "tag": "a8ca804a-2879-4f45-91f3-f7ace366691d"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:11:15.266184 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:11:15.266184 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:11:15.272916 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bd20945e-f89f-440f-a59d-823046160c45 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:15.273607 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bd20945e-f89f-440f-a59d-823046160c45 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:15.274760 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bd20945e-f89f-440f-a59d-823046160c45 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:15.275352 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bd20945e-f89f-440f-a59d-823046160c45 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:15.280740 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-8db82456-597e-42e6-94a1-b30d76997539 req-051b08fb-8ffc-404d-842d-58c9a8054259 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:15.283161 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-8db82456-597e-42e6-94a1-b30d76997539 req-051b08fb-8ffc-404d-842d-58c9a8054259 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:15.305141 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-bd20945e-f89f-440f-a59d-823046160c45 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Going to try to terminate instance {{(pid=123566) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 04 18:11:15.307245 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-8db82456-597e-42e6-94a1-b30d76997539 req-051b08fb-8ffc-404d-842d-58c9a8054259 service nova] Creating event network-changed:a8ca804a-2879-4f45-91f3-f7ace366691d for instance 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 on hv-cinder-82276 Feb 04 18:11:15.320078 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-8db82456-597e-42e6-94a1-b30d76997539 req-051b08fb-8ffc-404d-842d-58c9a8054259 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058430 Feb 04 18:11:15.320864 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 514/1038] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:11:15.411351 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e8859846-022e-4cfe-979d-f73e0618de37 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:15.413639 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-e8859846-022e-4cfe-979d-f73e0618de37 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:15.424681 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e8859846-022e-4cfe-979d-f73e0618de37 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:15.425723 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e8859846-022e-4cfe-979d-f73e0618de37 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:15.427641 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e8859846-022e-4cfe-979d-f73e0618de37 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:15.428840 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e8859846-022e-4cfe-979d-f73e0618de37 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:15.697372 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e8859846-022e-4cfe-979d-f73e0618de37 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:15.714999 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e8859846-022e-4cfe-979d-f73e0618de37 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:15.718574 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e8859846-022e-4cfe-979d-f73e0618de37 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:15.721217 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e8859846-022e-4cfe-979d-f73e0618de37 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1736 microversion: 2.20 time: 0.318136 Feb 04 18:11:15.722912 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 515/1039] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:15 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1736 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:11:15.765617 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-bd20945e-f89f-440f-a59d-823046160c45 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "DELETE /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 204 len: 0 microversion: 2.1 time: 0.508120 Feb 04 18:11:15.766211 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 525/1040] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Feb 4 18:11:15 2022] DELETE /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 04 18:11:15.774628 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-051a7ed2-37fb-4f8c-b5c2-825da821090b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:15.775701 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-051a7ed2-37fb-4f8c-b5c2-825da821090b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:15.782636 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-051a7ed2-37fb-4f8c-b5c2-825da821090b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:15.783775 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-051a7ed2-37fb-4f8c-b5c2-825da821090b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:15.784802 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-051a7ed2-37fb-4f8c-b5c2-825da821090b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:15.785455 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-051a7ed2-37fb-4f8c-b5c2-825da821090b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:15.988732 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-051a7ed2-37fb-4f8c-b5c2-825da821090b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:16.002338 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-051a7ed2-37fb-4f8c-b5c2-825da821090b tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1568 microversion: 2.1 time: 0.231608 Feb 04 18:11:16.004125 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 516/1041] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:11:15 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:11:16.742797 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-225f0194-8616-425f-8ba4-4d8587bfaa9d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:16.743617 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-225f0194-8616-425f-8ba4-4d8587bfaa9d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:16.750733 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-225f0194-8616-425f-8ba4-4d8587bfaa9d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:16.751454 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-225f0194-8616-425f-8ba4-4d8587bfaa9d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:16.752499 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-225f0194-8616-425f-8ba4-4d8587bfaa9d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:16.753137 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-225f0194-8616-425f-8ba4-4d8587bfaa9d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:16.914028 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-225f0194-8616-425f-8ba4-4d8587bfaa9d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:16.924293 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-225f0194-8616-425f-8ba4-4d8587bfaa9d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:16.926790 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-225f0194-8616-425f-8ba4-4d8587bfaa9d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:16.928399 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-225f0194-8616-425f-8ba4-4d8587bfaa9d tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1736 microversion: 2.20 time: 0.190251 Feb 04 18:11:16.929674 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 526/1042] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:16 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1736 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:17.023167 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-fd3c4d12-0605-4f9c-ae95-64b8c4d07645 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:17.023776 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-fd3c4d12-0605-4f9c-ae95-64b8c4d07645 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:17.031530 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fd3c4d12-0605-4f9c-ae95-64b8c4d07645 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:17.032189 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fd3c4d12-0605-4f9c-ae95-64b8c4d07645 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:17.033098 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fd3c4d12-0605-4f9c-ae95-64b8c4d07645 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:17.033641 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-fd3c4d12-0605-4f9c-ae95-64b8c4d07645 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:17.204488 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-fd3c4d12-0605-4f9c-ae95-64b8c4d07645 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:17.213662 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-fd3c4d12-0605-4f9c-ae95-64b8c4d07645 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1449 microversion: 2.1 time: 0.194791 Feb 04 18:11:17.214247 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 517/1043] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:11:17 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1449 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:11:17.951192 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-2d75dc11-18ea-42c5-af68-dd316e52ed5c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:17.952531 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-2d75dc11-18ea-42c5-af68-dd316e52ed5c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:17.960307 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2d75dc11-18ea-42c5-af68-dd316e52ed5c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:17.961163 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2d75dc11-18ea-42c5-af68-dd316e52ed5c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:17.962188 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2d75dc11-18ea-42c5-af68-dd316e52ed5c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:17.962875 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2d75dc11-18ea-42c5-af68-dd316e52ed5c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:18.117447 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2d75dc11-18ea-42c5-af68-dd316e52ed5c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:18.126072 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2d75dc11-18ea-42c5-af68-dd316e52ed5c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:18.129319 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2d75dc11-18ea-42c5-af68-dd316e52ed5c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:18.141136 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-2d75dc11-18ea-42c5-af68-dd316e52ed5c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1736 microversion: 2.20 time: 0.186320 Feb 04 18:11:18.142723 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 527/1044] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:17 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1736 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:18.233928 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-7863b46b-ddb4-474c-ba55-7c930d268d53 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:18.235397 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-7863b46b-ddb4-474c-ba55-7c930d268d53 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:18.247429 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7863b46b-ddb4-474c-ba55-7c930d268d53 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:18.248779 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7863b46b-ddb4-474c-ba55-7c930d268d53 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:18.250133 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7863b46b-ddb4-474c-ba55-7c930d268d53 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:18.250776 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7863b46b-ddb4-474c-ba55-7c930d268d53 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:18.403789 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-7863b46b-ddb4-474c-ba55-7c930d268d53 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:18.414353 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-7863b46b-ddb4-474c-ba55-7c930d268d53 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1449 microversion: 2.1 time: 0.184658 Feb 04 18:11:18.415059 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 518/1045] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:11:18 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1449 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:11:18.737081 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-b0b5cd91-cd23-4600-8489-d4160e197f8c req-862cd551-b0f0-4a40-9437-a666aaa38460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c4e346-86a3-4ecf-b0a8-5de2dced1ef1", "name": "network-vif-deleted", "tag": "a8ca804a-2879-4f45-91f3-f7ace366691d"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:11:18.739045 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:11:18.739045 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:11:18.746137 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-b0b5cd91-cd23-4600-8489-d4160e197f8c req-862cd551-b0f0-4a40-9437-a666aaa38460 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:18.746605 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-b0b5cd91-cd23-4600-8489-d4160e197f8c req-862cd551-b0f0-4a40-9437-a666aaa38460 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:18.758043 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-b0b5cd91-cd23-4600-8489-d4160e197f8c req-862cd551-b0f0-4a40-9437-a666aaa38460 service nova] Creating event network-vif-deleted:a8ca804a-2879-4f45-91f3-f7ace366691d for instance 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 on hv-cinder-82276 Feb 04 18:11:18.763120 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-b0b5cd91-cd23-4600-8489-d4160e197f8c req-862cd551-b0f0-4a40-9437-a666aaa38460 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029657 Feb 04 18:11:18.764024 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 528/1046] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:11:19.156402 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-433aa3d4-8571-4fbf-98b6-d3013d6d40b0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:19.156402 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-433aa3d4-8571-4fbf-98b6-d3013d6d40b0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:19.156803 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-433aa3d4-8571-4fbf-98b6-d3013d6d40b0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:19.157177 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-433aa3d4-8571-4fbf-98b6-d3013d6d40b0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:19.157990 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-433aa3d4-8571-4fbf-98b6-d3013d6d40b0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:19.158492 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-433aa3d4-8571-4fbf-98b6-d3013d6d40b0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:19.342059 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-433aa3d4-8571-4fbf-98b6-d3013d6d40b0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:19.352621 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-433aa3d4-8571-4fbf-98b6-d3013d6d40b0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:19.354670 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-433aa3d4-8571-4fbf-98b6-d3013d6d40b0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:19.356676 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-433aa3d4-8571-4fbf-98b6-d3013d6d40b0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1736 microversion: 2.20 time: 0.211167 Feb 04 18:11:19.357805 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 519/1047] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:19 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1736 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:19.432382 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-81b1786e-5887-4e8e-aa92-84a894c8af27 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:19.433766 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-81b1786e-5887-4e8e-aa92-84a894c8af27 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:19.441076 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-81b1786e-5887-4e8e-aa92-84a894c8af27 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:19.441523 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-81b1786e-5887-4e8e-aa92-84a894c8af27 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:19.442378 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-81b1786e-5887-4e8e-aa92-84a894c8af27 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:19.442917 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-81b1786e-5887-4e8e-aa92-84a894c8af27 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:19.516578 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-81b1786e-5887-4e8e-aa92-84a894c8af27 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:19.526622 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-81b1786e-5887-4e8e-aa92-84a894c8af27 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1217 microversion: 2.1 time: 0.098846 Feb 04 18:11:19.529547 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 529/1048] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:11:19 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:11:20.376381 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-113f45f3-3da1-4534-8716-6aedf343838b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:20.377515 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-113f45f3-3da1-4534-8716-6aedf343838b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:20.386097 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-113f45f3-3da1-4534-8716-6aedf343838b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:20.386898 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-113f45f3-3da1-4534-8716-6aedf343838b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:20.387876 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-113f45f3-3da1-4534-8716-6aedf343838b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:20.388477 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-113f45f3-3da1-4534-8716-6aedf343838b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:20.469221 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-7ecb0b3c-b9c8-48f4-8076-e859f7e0e9ae tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-75408714"}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:11:20.480105 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-7ecb0b3c-b9c8-48f4-8076-e859f7e0e9ae tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:20.492943 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7ecb0b3c-b9c8-48f4-8076-e859f7e0e9ae tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:20.493792 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7ecb0b3c-b9c8-48f4-8076-e859f7e0e9ae tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:20.495403 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7ecb0b3c-b9c8-48f4-8076-e859f7e0e9ae tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:20.496170 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7ecb0b3c-b9c8-48f4-8076-e859f7e0e9ae tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:20.651812 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-113f45f3-3da1-4534-8716-6aedf343838b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:20.666301 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-113f45f3-3da1-4534-8716-6aedf343838b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:20.668753 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-113f45f3-3da1-4534-8716-6aedf343838b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:20.670807 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-113f45f3-3da1-4534-8716-6aedf343838b tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1736 microversion: 2.20 time: 0.298119 Feb 04 18:11:20.671702 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 520/1049] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:20 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1736 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:20.681943 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.network.security_group_api [None req-7ecb0b3c-b9c8-48f4-8076-e859f7e0e9ae tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Removing security group bb487184-379f-4c12-a675-be51fef87f1e from port 83ecd4ba-cf52-4c67-b991-f2331aa88d95 Feb 04 18:11:20.690385 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-da386bfa-870a-406e-808c-4588e172d1f8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:20.690790 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-da386bfa-870a-406e-808c-4588e172d1f8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:20.702520 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-da386bfa-870a-406e-808c-4588e172d1f8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:20.703722 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-da386bfa-870a-406e-808c-4588e172d1f8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:20.705349 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-da386bfa-870a-406e-808c-4588e172d1f8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:20.706251 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-da386bfa-870a-406e-808c-4588e172d1f8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:20.755414 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-da386bfa-870a-406e-808c-4588e172d1f8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:20.758470 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-da386bfa-870a-406e-808c-4588e172d1f8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:20.759140 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.objects.instance [None req-da386bfa-870a-406e-808c-4588e172d1f8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lazy-loading 'fault' on Instance uuid 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 {{(pid=123567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:11:20.837613 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-da386bfa-870a-406e-808c-4588e172d1f8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6861d0a7e0154e8da9405d706cde0313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2493fd3d7f84ef0ac9f24b259ec02d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:20.852054 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-da386bfa-870a-406e-808c-4588e172d1f8 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 200 len: 1222 microversion: 2.1 time: 0.178959 Feb 04 18:11:20.852659 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 521/1050] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:11:20 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 1222 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:11:21.291212 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-7ecb0b3c-b9c8-48f4-8076-e859f7e0e9ae tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "POST /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe/action" status: 202 len: 0 microversion: 2.1 time: 0.829475 Feb 04 18:11:21.292043 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 530/1051] 10.222.0.98 () {60 vars in 1277 bytes} [Fri Feb 4 18:11:20 2022] POST /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe/action => generated 0 bytes in 833 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 04 18:11:21.323748 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-cfbb8674-0104-4a5e-84d7-364d25a4dfef req-14bceba7-45b6-4966-b494-94f172dd4d69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "511d5301-1a67-4334-91b8-88220c31cefe", "tag": "83ecd4ba-cf52-4c67-b991-f2331aa88d95"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:11:21.325396 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:11:21.325396 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:11:21.341071 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-cfbb8674-0104-4a5e-84d7-364d25a4dfef req-14bceba7-45b6-4966-b494-94f172dd4d69 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:21.341562 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-cfbb8674-0104-4a5e-84d7-364d25a4dfef req-14bceba7-45b6-4966-b494-94f172dd4d69 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:21.396010 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-cfbb8674-0104-4a5e-84d7-364d25a4dfef req-14bceba7-45b6-4966-b494-94f172dd4d69 service nova] Creating event network-changed:83ecd4ba-cf52-4c67-b991-f2331aa88d95 for instance 511d5301-1a67-4334-91b8-88220c31cefe on hv-cinder-82276 Feb 04 18:11:21.403827 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-cfbb8674-0104-4a5e-84d7-364d25a4dfef req-14bceba7-45b6-4966-b494-94f172dd4d69 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087435 Feb 04 18:11:21.407229 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 522/1052] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:11:21.693297 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-742679a6-b803-4abb-b88f-c1e6f20a19d1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:21.695825 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-742679a6-b803-4abb-b88f-c1e6f20a19d1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:21.704552 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-742679a6-b803-4abb-b88f-c1e6f20a19d1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:21.705408 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-742679a6-b803-4abb-b88f-c1e6f20a19d1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:21.707028 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-742679a6-b803-4abb-b88f-c1e6f20a19d1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:21.707702 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-742679a6-b803-4abb-b88f-c1e6f20a19d1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:21.877191 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-25c61310-5e96-4729-82d8-c7ac3ca65657 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:21.877716 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-25c61310-5e96-4729-82d8-c7ac3ca65657 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [instance: 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:21.896859 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-25c61310-5e96-4729-82d8-c7ac3ca65657 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:21.897992 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-25c61310-5e96-4729-82d8-c7ac3ca65657 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:21.898948 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-25c61310-5e96-4729-82d8-c7ac3ca65657 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:21.899394 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-25c61310-5e96-4729-82d8-c7ac3ca65657 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:21.935853 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.wsgi [None req-25c61310-5e96-4729-82d8-c7ac3ca65657 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] HTTP exception thrown: Instance 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 could not be found. Feb 04 18:11:21.936485 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-25c61310-5e96-4729-82d8-c7ac3ca65657 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Returning 404 to user: Instance 78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 could not be found. {{(pid=123567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:11:21.937344 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-25c61310-5e96-4729-82d8-c7ac3ca65657 tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1" status: 404 len: 111 microversion: 2.1 time: 0.065963 Feb 04 18:11:21.941424 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 523/1053] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:11:21 2022] GET /compute/v2.1/servers/78c4e346-86a3-4ecf-b0a8-5de2dced1ef1 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 04 18:11:21.995977 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-742679a6-b803-4abb-b88f-c1e6f20a19d1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:22.009103 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-742679a6-b803-4abb-b88f-c1e6f20a19d1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:22.010782 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-742679a6-b803-4abb-b88f-c1e6f20a19d1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:22.012020 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-742679a6-b803-4abb-b88f-c1e6f20a19d1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1736 microversion: 2.20 time: 0.325561 Feb 04 18:11:22.023538 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 531/1054] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:21 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1736 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:22.343348 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-f5d2ed5f-5e55-438f-ad45-785ab8235dda tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] Calling method '.version_select at 0x7fe8d0c34a60>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:22.347667 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f5d2ed5f-5e55-438f-ad45-785ab8235dda tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [84178c9a-4299-4b0f-827b-43ba51d97f4b] AMQP server on 10.222.0.98:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 04 18:11:23.034599 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-e19ffd85-e759-4a19-a7a6-5ae0cdbcbcd7 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:23.035252 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-e19ffd85-e759-4a19-a7a6-5ae0cdbcbcd7 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:23.042452 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e19ffd85-e759-4a19-a7a6-5ae0cdbcbcd7 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:23.042916 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e19ffd85-e759-4a19-a7a6-5ae0cdbcbcd7 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:23.043710 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e19ffd85-e759-4a19-a7a6-5ae0cdbcbcd7 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:23.044159 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e19ffd85-e759-4a19-a7a6-5ae0cdbcbcd7 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:23.336399 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-e19ffd85-e759-4a19-a7a6-5ae0cdbcbcd7 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:23.359410 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO oslo.messaging._drivers.impl_rabbit [None req-f5d2ed5f-5e55-438f-ad45-785ab8235dda tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] [84178c9a-4299-4b0f-827b-43ba51d97f4b] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 33180. Feb 04 18:11:23.360365 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-e19ffd85-e759-4a19-a7a6-5ae0cdbcbcd7 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:23.364069 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-e19ffd85-e759-4a19-a7a6-5ae0cdbcbcd7 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:23.366602 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-e19ffd85-e759-4a19-a7a6-5ae0cdbcbcd7 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1736 microversion: 2.20 time: 0.335886 Feb 04 18:11:23.372491 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 532/1055] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:23 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1736 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:11:23.458043 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-f5d2ed5f-5e55-438f-ad45-785ab8235dda tempest-TestShelveInstance-1265481611 tempest-TestShelveInstance-1265481611-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-860948762" status: 202 len: 0 microversion: 2.1 time: 1.119341 Feb 04 18:11:23.458652 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 524/1056] 10.222.0.98 () {58 vars in 1250 bytes} [Fri Feb 4 18:11:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-860948762 => generated 0 bytes in 1121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 04 18:11:23.610133 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-01137cf4-9636-44a3-99b1-63a68c9f51f1 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:23.611212 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-01137cf4-9636-44a3-99b1-63a68c9f51f1 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:23.626408 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-f9e192cb-3497-4524-bb85-2a822a1143b4 req-87d2ba69-8b41-4de4-9f01-184da0d3f928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "511d5301-1a67-4334-91b8-88220c31cefe", "tag": "83ecd4ba-cf52-4c67-b991-f2331aa88d95"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:11:23.628066 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-01137cf4-9636-44a3-99b1-63a68c9f51f1 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:23.628464 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:11:23.628464 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:11:23.628639 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-01137cf4-9636-44a3-99b1-63a68c9f51f1 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:23.629337 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-01137cf4-9636-44a3-99b1-63a68c9f51f1 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:23.629781 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-01137cf4-9636-44a3-99b1-63a68c9f51f1 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:23.648613 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-f9e192cb-3497-4524-bb85-2a822a1143b4 req-87d2ba69-8b41-4de4-9f01-184da0d3f928 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:23.651454 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-f9e192cb-3497-4524-bb85-2a822a1143b4 req-87d2ba69-8b41-4de4-9f01-184da0d3f928 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:23.667788 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-f9e192cb-3497-4524-bb85-2a822a1143b4 req-87d2ba69-8b41-4de4-9f01-184da0d3f928 service nova] Creating event network-changed:83ecd4ba-cf52-4c67-b991-f2331aa88d95 for instance 511d5301-1a67-4334-91b8-88220c31cefe on hv-cinder-82276 Feb 04 18:11:23.672738 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-f9e192cb-3497-4524-bb85-2a822a1143b4 req-87d2ba69-8b41-4de4-9f01-184da0d3f928 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060642 Feb 04 18:11:23.678605 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 525/1057] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:11:23.768059 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.objects.instance [None req-01137cf4-9636-44a3-99b1-63a68c9f51f1 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lazy-loading 'services' on Instance uuid 511d5301-1a67-4334-91b8-88220c31cefe {{(pid=123566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:11:24.016766 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-01137cf4-9636-44a3-99b1-63a68c9f51f1 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "DELETE /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe/os-volume_attachments/0b70392c-a196-4de5-8db8-4617fd7031f5" status: 202 len: 0 microversion: 2.1 time: 0.410528 Feb 04 18:11:24.019720 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 533/1058] 10.222.0.98 () {58 vars in 1415 bytes} [Fri Feb 4 18:11:23 2022] DELETE /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe/os-volume_attachments/0b70392c-a196-4de5-8db8-4617fd7031f5 => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 04 18:11:24.034104 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-71eea3a5-c0d5-4632-8faa-d3d567ccf72f tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:24.040201 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-71eea3a5-c0d5-4632-8faa-d3d567ccf72f tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:24.051496 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-71eea3a5-c0d5-4632-8faa-d3d567ccf72f tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:24.054878 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-71eea3a5-c0d5-4632-8faa-d3d567ccf72f tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:24.056953 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-71eea3a5-c0d5-4632-8faa-d3d567ccf72f tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:24.058183 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-71eea3a5-c0d5-4632-8faa-d3d567ccf72f tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:24.120224 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-71eea3a5-c0d5-4632-8faa-d3d567ccf72f tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094620 Feb 04 18:11:24.121150 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 526/1059] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:11:24 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:11:24.392143 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-c66d17ca-15ad-4896-8c45-0b6b738d98c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:24.392842 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-c66d17ca-15ad-4896-8c45-0b6b738d98c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:24.407901 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c66d17ca-15ad-4896-8c45-0b6b738d98c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:24.408644 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c66d17ca-15ad-4896-8c45-0b6b738d98c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:24.409640 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c66d17ca-15ad-4896-8c45-0b6b738d98c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:24.413439 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c66d17ca-15ad-4896-8c45-0b6b738d98c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:24.622226 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c66d17ca-15ad-4896-8c45-0b6b738d98c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:24.640170 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c66d17ca-15ad-4896-8c45-0b6b738d98c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:24.642446 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c66d17ca-15ad-4896-8c45-0b6b738d98c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:24.644051 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-c66d17ca-15ad-4896-8c45-0b6b738d98c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1736 microversion: 2.20 time: 0.255974 Feb 04 18:11:24.644989 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 534/1060] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:24 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1736 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:25.133085 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-6e0bf887-f4d1-4125-9f40-b453b1571bc5 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:25.134046 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-6e0bf887-f4d1-4125-9f40-b453b1571bc5 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:25.140879 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6e0bf887-f4d1-4125-9f40-b453b1571bc5 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:25.141619 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6e0bf887-f4d1-4125-9f40-b453b1571bc5 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:25.145431 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6e0bf887-f4d1-4125-9f40-b453b1571bc5 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:25.145431 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-6e0bf887-f4d1-4125-9f40-b453b1571bc5 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:25.180755 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-6e0bf887-f4d1-4125-9f40-b453b1571bc5 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052315 Feb 04 18:11:25.187861 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 527/1061] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:11:25 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:11:25.665285 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-19a6130e-440e-48c4-a65d-d0e396d158df tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:25.665963 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-19a6130e-440e-48c4-a65d-d0e396d158df tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:25.672754 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-19a6130e-440e-48c4-a65d-d0e396d158df tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:25.674257 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-19a6130e-440e-48c4-a65d-d0e396d158df tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:25.674257 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-19a6130e-440e-48c4-a65d-d0e396d158df tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:25.674621 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-19a6130e-440e-48c4-a65d-d0e396d158df tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:25.860307 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-19a6130e-440e-48c4-a65d-d0e396d158df tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:25.877921 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-19a6130e-440e-48c4-a65d-d0e396d158df tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:25.879762 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-19a6130e-440e-48c4-a65d-d0e396d158df tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:25.881118 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-19a6130e-440e-48c4-a65d-d0e396d158df tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1736 microversion: 2.20 time: 0.220566 Feb 04 18:11:25.881981 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 535/1062] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:25 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:26.193376 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-8d6f6131-1b71-4d98-a6c4-c079466829f2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:26.194820 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-8d6f6131-1b71-4d98-a6c4-c079466829f2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:26.201485 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8d6f6131-1b71-4d98-a6c4-c079466829f2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:26.202315 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8d6f6131-1b71-4d98-a6c4-c079466829f2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:26.203255 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8d6f6131-1b71-4d98-a6c4-c079466829f2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:26.203770 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8d6f6131-1b71-4d98-a6c4-c079466829f2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:26.234703 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-8d6f6131-1b71-4d98-a6c4-c079466829f2 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045414 Feb 04 18:11:26.235413 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 528/1063] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:11:26 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 04 18:11:26.247101 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b83bbe90-45da-45b3-86e7-885cf48268ab tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:26.248213 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-b83bbe90-45da-45b3-86e7-885cf48268ab tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:26.255758 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b83bbe90-45da-45b3-86e7-885cf48268ab tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:26.257204 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b83bbe90-45da-45b3-86e7-885cf48268ab tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:26.258228 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b83bbe90-45da-45b3-86e7-885cf48268ab tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:26.258756 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b83bbe90-45da-45b3-86e7-885cf48268ab tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:26.359594 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-b83bbe90-45da-45b3-86e7-885cf48268ab tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] HTTP exception thrown: Instance 511d5301-1a67-4334-91b8-88220c31cefe is not attached to volume 0b70392c-a196-4de5-8db8-4617fd7031f5 Feb 04 18:11:26.360478 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b83bbe90-45da-45b3-86e7-885cf48268ab tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Returning 404 to user: Instance 511d5301-1a67-4334-91b8-88220c31cefe is not attached to volume 0b70392c-a196-4de5-8db8-4617fd7031f5 {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:11:26.361562 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-b83bbe90-45da-45b3-86e7-885cf48268ab tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "DELETE /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe/os-volume_attachments/0b70392c-a196-4de5-8db8-4617fd7031f5" status: 404 len: 154 microversion: 2.1 time: 0.120013 Feb 04 18:11:26.362301 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 536/1064] 10.222.0.98 () {58 vars in 1415 bytes} [Fri Feb 4 18:11:26 2022] DELETE /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe/os-volume_attachments/0b70392c-a196-4de5-8db8-4617fd7031f5 => generated 154 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 04 18:11:26.900317 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-7ebb531d-0d11-4400-8fdd-6b575020a89a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:26.901115 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-7ebb531d-0d11-4400-8fdd-6b575020a89a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:26.912261 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7ebb531d-0d11-4400-8fdd-6b575020a89a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:26.912741 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7ebb531d-0d11-4400-8fdd-6b575020a89a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:26.913554 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7ebb531d-0d11-4400-8fdd-6b575020a89a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:26.913998 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7ebb531d-0d11-4400-8fdd-6b575020a89a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:27.253155 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-7ebb531d-0d11-4400-8fdd-6b575020a89a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:27.263694 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-7ebb531d-0d11-4400-8fdd-6b575020a89a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:27.265263 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-7ebb531d-0d11-4400-8fdd-6b575020a89a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:27.266529 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-7ebb531d-0d11-4400-8fdd-6b575020a89a tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1736 microversion: 2.20 time: 0.370508 Feb 04 18:11:27.267101 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 529/1065] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:26 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1736 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:27.689894 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-563ddc3d-cc2f-4ad9-899b-84eeef092183 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:27.690501 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-563ddc3d-cc2f-4ad9-899b-84eeef092183 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:27.697550 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-563ddc3d-cc2f-4ad9-899b-84eeef092183 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:27.698325 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-563ddc3d-cc2f-4ad9-899b-84eeef092183 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:27.699389 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-563ddc3d-cc2f-4ad9-899b-84eeef092183 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:27.699828 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-563ddc3d-cc2f-4ad9-899b-84eeef092183 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:27.726071 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-563ddc3d-cc2f-4ad9-899b-84eeef092183 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Going to try to terminate instance {{(pid=123566) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 04 18:11:28.189769 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-563ddc3d-cc2f-4ad9-899b-84eeef092183 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "DELETE /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 204 len: 0 microversion: 2.1 time: 0.503170 Feb 04 18:11:28.190362 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 537/1066] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Feb 4 18:11:27 2022] DELETE /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 04 18:11:28.199167 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-4ef2b13e-ba08-4c1e-b646-c927ce481b92 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:28.200062 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-4ef2b13e-ba08-4c1e-b646-c927ce481b92 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:28.207316 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4ef2b13e-ba08-4c1e-b646-c927ce481b92 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:28.207787 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4ef2b13e-ba08-4c1e-b646-c927ce481b92 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:28.208649 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4ef2b13e-ba08-4c1e-b646-c927ce481b92 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:28.209095 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4ef2b13e-ba08-4c1e-b646-c927ce481b92 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:28.286693 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-d8bc443c-71f1-4c5d-a502-f9818f2e91b4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:28.287589 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-d8bc443c-71f1-4c5d-a502-f9818f2e91b4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:28.304856 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d8bc443c-71f1-4c5d-a502-f9818f2e91b4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:28.306358 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d8bc443c-71f1-4c5d-a502-f9818f2e91b4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:28.308557 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d8bc443c-71f1-4c5d-a502-f9818f2e91b4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:28.309123 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d8bc443c-71f1-4c5d-a502-f9818f2e91b4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:28.449389 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-4ef2b13e-ba08-4c1e-b646-c927ce481b92 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:28.463320 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-4ef2b13e-ba08-4c1e-b646-c927ce481b92 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1552 microversion: 2.1 time: 0.268134 Feb 04 18:11:28.463910 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 530/1067] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:11:28 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1552 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:11:28.558578 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-d8bc443c-71f1-4c5d-a502-f9818f2e91b4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:28.566788 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-d8bc443c-71f1-4c5d-a502-f9818f2e91b4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:28.569965 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-d8bc443c-71f1-4c5d-a502-f9818f2e91b4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:28.570470 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-d8bc443c-71f1-4c5d-a502-f9818f2e91b4 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1736 microversion: 2.20 time: 0.287939 Feb 04 18:11:28.571295 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 538/1068] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:28 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1736 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:11:29.481127 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b6e4b93b-60c2-410f-b1e2-4670926c421a tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:29.482628 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-b6e4b93b-60c2-410f-b1e2-4670926c421a tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:29.489223 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b6e4b93b-60c2-410f-b1e2-4670926c421a tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:29.489934 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b6e4b93b-60c2-410f-b1e2-4670926c421a tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:29.491266 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b6e4b93b-60c2-410f-b1e2-4670926c421a tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:29.491706 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b6e4b93b-60c2-410f-b1e2-4670926c421a tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:29.590582 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-a63dc277-d3f7-4676-888c-94b8e55549d8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:29.591380 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-a63dc277-d3f7-4676-888c-94b8e55549d8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:29.597667 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a63dc277-d3f7-4676-888c-94b8e55549d8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:29.598109 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a63dc277-d3f7-4676-888c-94b8e55549d8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:29.598943 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a63dc277-d3f7-4676-888c-94b8e55549d8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:29.599387 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a63dc277-d3f7-4676-888c-94b8e55549d8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:29.756827 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-b6e4b93b-60c2-410f-b1e2-4670926c421a tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:29.765728 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b6e4b93b-60c2-410f-b1e2-4670926c421a tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1552 microversion: 2.1 time: 0.288131 Feb 04 18:11:29.766126 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 531/1069] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:11:29 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1552 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:11:29.846769 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-a63dc277-d3f7-4676-888c-94b8e55549d8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:29.855745 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-a63dc277-d3f7-4676-888c-94b8e55549d8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:29.857307 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-a63dc277-d3f7-4676-888c-94b8e55549d8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:29.858509 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-a63dc277-d3f7-4676-888c-94b8e55549d8 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1736 microversion: 2.20 time: 0.271729 Feb 04 18:11:29.859136 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 539/1070] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:29 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1736 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:11:30.788870 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-53795b3e-7aba-4766-a0ee-169597ac600e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:30.789512 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-53795b3e-7aba-4766-a0ee-169597ac600e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:30.802876 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-53795b3e-7aba-4766-a0ee-169597ac600e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:30.803878 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-53795b3e-7aba-4766-a0ee-169597ac600e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:30.804680 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-53795b3e-7aba-4766-a0ee-169597ac600e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:30.805121 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-53795b3e-7aba-4766-a0ee-169597ac600e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:30.878674 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-26a79df0-d5b1-496c-8b20-9ac74c95a494 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:30.879579 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-26a79df0-d5b1-496c-8b20-9ac74c95a494 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:30.887248 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-26a79df0-d5b1-496c-8b20-9ac74c95a494 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:30.888168 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-26a79df0-d5b1-496c-8b20-9ac74c95a494 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:30.889226 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-26a79df0-d5b1-496c-8b20-9ac74c95a494 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:30.890232 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-26a79df0-d5b1-496c-8b20-9ac74c95a494 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:31.320565 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-53795b3e-7aba-4766-a0ee-169597ac600e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:31.331253 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-53795b3e-7aba-4766-a0ee-169597ac600e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1552 microversion: 2.1 time: 0.545976 Feb 04 18:11:31.346328 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 532/1071] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:11:30 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1552 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:11:31.401309 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-26a79df0-d5b1-496c-8b20-9ac74c95a494 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:31.442652 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-26a79df0-d5b1-496c-8b20-9ac74c95a494 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:31.448277 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-26a79df0-d5b1-496c-8b20-9ac74c95a494 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:31.454682 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-26a79df0-d5b1-496c-8b20-9ac74c95a494 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1718 microversion: 2.20 time: 0.580501 Feb 04 18:11:31.455757 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 540/1072] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:30 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1718 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:11:31.478726 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-970db952-4d0f-4042-99a9-78a9bc1abf0f req-abf304e5-7052-49ea-a4ce-bfa3df5e2eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "511d5301-1a67-4334-91b8-88220c31cefe", "name": "network-vif-deleted", "tag": "83ecd4ba-cf52-4c67-b991-f2331aa88d95"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:11:31.480584 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:11:31.480584 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:11:31.487854 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-970db952-4d0f-4042-99a9-78a9bc1abf0f req-abf304e5-7052-49ea-a4ce-bfa3df5e2eda service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:31.507634 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-970db952-4d0f-4042-99a9-78a9bc1abf0f req-abf304e5-7052-49ea-a4ce-bfa3df5e2eda service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:31.507634 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-970db952-4d0f-4042-99a9-78a9bc1abf0f req-abf304e5-7052-49ea-a4ce-bfa3df5e2eda service nova] Creating event network-vif-deleted:83ecd4ba-cf52-4c67-b991-f2331aa88d95 for instance 511d5301-1a67-4334-91b8-88220c31cefe on hv-cinder-82276 Feb 04 18:11:31.507634 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-970db952-4d0f-4042-99a9-78a9bc1abf0f req-abf304e5-7052-49ea-a4ce-bfa3df5e2eda service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031197 Feb 04 18:11:31.507634 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 533/1073] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:11:32.353469 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ca93fc9e-1be5-40a7-9597-a5d056aa17fa tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:32.354773 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ca93fc9e-1be5-40a7-9597-a5d056aa17fa tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:32.361656 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ca93fc9e-1be5-40a7-9597-a5d056aa17fa tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:32.362108 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ca93fc9e-1be5-40a7-9597-a5d056aa17fa tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:32.363344 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ca93fc9e-1be5-40a7-9597-a5d056aa17fa tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:32.363634 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ca93fc9e-1be5-40a7-9597-a5d056aa17fa tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:32.395485 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ca93fc9e-1be5-40a7-9597-a5d056aa17fa tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:32.395933 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ca93fc9e-1be5-40a7-9597-a5d056aa17fa tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:32.396387 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.objects.instance [None req-ca93fc9e-1be5-40a7-9597-a5d056aa17fa tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lazy-loading 'fault' on Instance uuid 511d5301-1a67-4334-91b8-88220c31cefe {{(pid=123566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:11:32.444608 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-ca93fc9e-1be5-40a7-9597-a5d056aa17fa tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaad40ced6942a2bb04356175706b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369ffaf0cb1e4d2f913bfd52d63bf010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:32.452566 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ca93fc9e-1be5-40a7-9597-a5d056aa17fa tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 200 len: 1347 microversion: 2.1 time: 0.102601 Feb 04 18:11:32.453128 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 541/1074] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:11:32 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 1347 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:11:32.476315 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-88b98f8d-336f-4cdc-8dd6-0111a8962385 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:32.477045 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-88b98f8d-336f-4cdc-8dd6-0111a8962385 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:32.483540 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-88b98f8d-336f-4cdc-8dd6-0111a8962385 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:32.484227 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-88b98f8d-336f-4cdc-8dd6-0111a8962385 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:32.485079 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-88b98f8d-336f-4cdc-8dd6-0111a8962385 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:32.485556 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-88b98f8d-336f-4cdc-8dd6-0111a8962385 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:32.684431 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-88b98f8d-336f-4cdc-8dd6-0111a8962385 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:32.695984 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-88b98f8d-336f-4cdc-8dd6-0111a8962385 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:32.697941 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-88b98f8d-336f-4cdc-8dd6-0111a8962385 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:32.699359 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-88b98f8d-336f-4cdc-8dd6-0111a8962385 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1718 microversion: 2.20 time: 0.227603 Feb 04 18:11:32.700081 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 534/1075] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:32 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1718 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:11:33.469061 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b4cb62e1-e86b-4bd9-a03d-e131d417fa8e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:33.469682 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-b4cb62e1-e86b-4bd9-a03d-e131d417fa8e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] [instance: 511d5301-1a67-4334-91b8-88220c31cefe] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:33.476471 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b4cb62e1-e86b-4bd9-a03d-e131d417fa8e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:33.476925 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b4cb62e1-e86b-4bd9-a03d-e131d417fa8e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:33.477710 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b4cb62e1-e86b-4bd9-a03d-e131d417fa8e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:33.478145 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b4cb62e1-e86b-4bd9-a03d-e131d417fa8e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:33.496652 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-b4cb62e1-e86b-4bd9-a03d-e131d417fa8e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] HTTP exception thrown: Instance 511d5301-1a67-4334-91b8-88220c31cefe could not be found. Feb 04 18:11:33.497725 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b4cb62e1-e86b-4bd9-a03d-e131d417fa8e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Returning 404 to user: Instance 511d5301-1a67-4334-91b8-88220c31cefe could not be found. {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:11:33.499805 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-b4cb62e1-e86b-4bd9-a03d-e131d417fa8e tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe" status: 404 len: 111 microversion: 2.1 time: 0.034398 Feb 04 18:11:33.501171 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 542/1076] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:11:33 2022] GET /compute/v2.1/servers/511d5301-1a67-4334-91b8-88220c31cefe => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:11:33.511650 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3d0fb822-fb96-4d7d-814c-cf2511f4a835 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] Calling method '.version_select at 0x7fe8cc8edb80>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:33.641258 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-3d0fb822-fb96-4d7d-814c-cf2511f4a835 tempest-TestMinimumBasicScenario-1580513501 tempest-TestMinimumBasicScenario-1580513501-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-189574940" status: 202 len: 0 microversion: 2.1 time: 0.127183 Feb 04 18:11:33.641258 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 535/1077] 10.222.0.98 () {58 vars in 1268 bytes} [Fri Feb 4 18:11:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-189574940 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 04 18:11:33.717343 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-90b2ed1a-0ef2-421e-9493-3ecff15c6065 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:33.717956 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-90b2ed1a-0ef2-421e-9493-3ecff15c6065 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:33.724321 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-90b2ed1a-0ef2-421e-9493-3ecff15c6065 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:33.724785 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-90b2ed1a-0ef2-421e-9493-3ecff15c6065 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:33.726219 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-90b2ed1a-0ef2-421e-9493-3ecff15c6065 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:33.726692 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-90b2ed1a-0ef2-421e-9493-3ecff15c6065 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:33.946364 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-90b2ed1a-0ef2-421e-9493-3ecff15c6065 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:33.956623 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-90b2ed1a-0ef2-421e-9493-3ecff15c6065 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:33.958178 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-90b2ed1a-0ef2-421e-9493-3ecff15c6065 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:33.959937 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-90b2ed1a-0ef2-421e-9493-3ecff15c6065 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1718 microversion: 2.20 time: 0.246008 Feb 04 18:11:33.961007 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 543/1078] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:33 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1718 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:33.997058 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-7b967d45-779f-49e1-91e8-82324ded5f2a req-dcdd9c5b-8dbf-4f49-a67f-0adab71bff31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32416d02-187d-4d8f-9698-d36ac5ffbc26", "name": "network-vif-unplugged", "status": "completed", "tag": "8dbc5ea2-225d-4915-8e59-f39e014f906a"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:11:33.998658 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:11:33.998658 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:11:34.006434 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-7b967d45-779f-49e1-91e8-82324ded5f2a req-dcdd9c5b-8dbf-4f49-a67f-0adab71bff31 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:34.006898 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-7b967d45-779f-49e1-91e8-82324ded5f2a req-dcdd9c5b-8dbf-4f49-a67f-0adab71bff31 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:34.017565 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-7b967d45-779f-49e1-91e8-82324ded5f2a req-dcdd9c5b-8dbf-4f49-a67f-0adab71bff31 service nova] Creating event network-vif-unplugged:8dbc5ea2-225d-4915-8e59-f39e014f906a for instance 32416d02-187d-4d8f-9698-d36ac5ffbc26 on hv-cinder-82276 Feb 04 18:11:34.023127 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-7b967d45-779f-49e1-91e8-82324ded5f2a req-dcdd9c5b-8dbf-4f49-a67f-0adab71bff31 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029811 Feb 04 18:11:34.023732 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 536/1079] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:11:34.978486 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-006cf201-ac32-403b-ae28-4957d054fc1f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:34.979082 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-006cf201-ac32-403b-ae28-4957d054fc1f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:34.985377 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-006cf201-ac32-403b-ae28-4957d054fc1f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:34.987358 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-006cf201-ac32-403b-ae28-4957d054fc1f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:34.987358 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-006cf201-ac32-403b-ae28-4957d054fc1f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:34.987358 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-006cf201-ac32-403b-ae28-4957d054fc1f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:35.135685 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-006cf201-ac32-403b-ae28-4957d054fc1f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:35.144270 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-006cf201-ac32-403b-ae28-4957d054fc1f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:35.146120 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-006cf201-ac32-403b-ae28-4957d054fc1f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:35.147345 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-006cf201-ac32-403b-ae28-4957d054fc1f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1661 microversion: 2.20 time: 0.173082 Feb 04 18:11:35.147982 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 544/1080] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:34 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1661 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:35.168296 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e5d55e8a-3035-417d-a78b-bb0f0d9853cf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a3aeb19-08f6-47c9-97dd-59f983e7deaf"}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:11:35.169439 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-e5d55e8a-3035-417d-a78b-bb0f0d9853cf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:35.176061 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e5d55e8a-3035-417d-a78b-bb0f0d9853cf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:35.176529 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e5d55e8a-3035-417d-a78b-bb0f0d9853cf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:35.177331 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e5d55e8a-3035-417d-a78b-bb0f0d9853cf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:35.177773 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e5d55e8a-3035-417d-a78b-bb0f0d9853cf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:36.336243 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e5d55e8a-3035-417d-a78b-bb0f0d9853cf tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "POST /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.173837 Feb 04 18:11:36.341546 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 537/1081] 10.222.0.98 () {62 vars in 1363 bytes} [Fri Feb 4 18:11:35 2022] POST /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26/os-volume_attachments => generated 188 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 04 18:11:36.455171 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b9d5e5e5-8fe6-4b5c-9192-4fa48d623422 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:36.455724 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-b9d5e5e5-8fe6-4b5c-9192-4fa48d623422 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:36.461767 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b9d5e5e5-8fe6-4b5c-9192-4fa48d623422 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:36.462525 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b9d5e5e5-8fe6-4b5c-9192-4fa48d623422 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:36.463325 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b9d5e5e5-8fe6-4b5c-9192-4fa48d623422 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:36.463937 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b9d5e5e5-8fe6-4b5c-9192-4fa48d623422 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:37.239788 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-b9d5e5e5-8fe6-4b5c-9192-4fa48d623422 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "DELETE /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26/os-volume_attachments/4a3aeb19-08f6-47c9-97dd-59f983e7deaf" status: 202 len: 0 microversion: 2.20 time: 0.788160 Feb 04 18:11:37.240592 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 545/1082] 10.222.0.98 () {60 vars in 1456 bytes} [Fri Feb 4 18:11:36 2022] DELETE /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26/os-volume_attachments/4a3aeb19-08f6-47c9-97dd-59f983e7deaf => generated 0 bytes in 790 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 04 18:11:37.312953 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a21bedb4-3449-446a-8f8d-3535ceb29a9c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:11:37.313439 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-a21bedb4-3449-446a-8f8d-3535ceb29a9c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:37.324135 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a21bedb4-3449-446a-8f8d-3535ceb29a9c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:37.324603 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a21bedb4-3449-446a-8f8d-3535ceb29a9c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:37.325455 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a21bedb4-3449-446a-8f8d-3535ceb29a9c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:37.325969 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a21bedb4-3449-446a-8f8d-3535ceb29a9c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:37.626934 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a21bedb4-3449-446a-8f8d-3535ceb29a9c tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "POST /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26/action" status: 202 len: 0 microversion: 2.20 time: 0.317937 Feb 04 18:11:37.633149 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 538/1083] 10.222.0.98 () {62 vars in 1318 bytes} [Fri Feb 4 18:11:37 2022] POST /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 04 18:11:37.638241 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-d2dd3a94-ea0f-411e-951e-b2e5365307eb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:37.639338 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-d2dd3a94-ea0f-411e-951e-b2e5365307eb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:37.649989 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d2dd3a94-ea0f-411e-951e-b2e5365307eb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:37.650860 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d2dd3a94-ea0f-411e-951e-b2e5365307eb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:37.652156 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d2dd3a94-ea0f-411e-951e-b2e5365307eb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:37.652746 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d2dd3a94-ea0f-411e-951e-b2e5365307eb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:37.937617 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-d2dd3a94-ea0f-411e-951e-b2e5365307eb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:37.967780 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-d2dd3a94-ea0f-411e-951e-b2e5365307eb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:37.995767 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-d2dd3a94-ea0f-411e-951e-b2e5365307eb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:37.996742 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-d2dd3a94-ea0f-411e-951e-b2e5365307eb tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1669 microversion: 2.20 time: 0.362685 Feb 04 18:11:38.001489 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 546/1084] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:37 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1669 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:39.026656 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-d3bd9dc9-49c4-4fc9-b3c6-cc5d3d845420 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:39.030574 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-d3bd9dc9-49c4-4fc9-b3c6-cc5d3d845420 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:39.033484 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d3bd9dc9-49c4-4fc9-b3c6-cc5d3d845420 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:39.033940 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d3bd9dc9-49c4-4fc9-b3c6-cc5d3d845420 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:39.034781 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d3bd9dc9-49c4-4fc9-b3c6-cc5d3d845420 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:39.035225 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d3bd9dc9-49c4-4fc9-b3c6-cc5d3d845420 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:39.254021 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-d3bd9dc9-49c4-4fc9-b3c6-cc5d3d845420 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:39.254021 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-d3bd9dc9-49c4-4fc9-b3c6-cc5d3d845420 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:39.256972 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-d3bd9dc9-49c4-4fc9-b3c6-cc5d3d845420 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:39.258903 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-d3bd9dc9-49c4-4fc9-b3c6-cc5d3d845420 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1669 microversion: 2.20 time: 0.237093 Feb 04 18:11:39.260984 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 539/1085] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:39 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1669 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:40.278036 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-861c0a51-37f2-4182-8362-fd22b7f45cf3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:40.278723 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-861c0a51-37f2-4182-8362-fd22b7f45cf3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:40.285430 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-861c0a51-37f2-4182-8362-fd22b7f45cf3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:40.285888 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-861c0a51-37f2-4182-8362-fd22b7f45cf3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:40.286737 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-861c0a51-37f2-4182-8362-fd22b7f45cf3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:40.287303 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-861c0a51-37f2-4182-8362-fd22b7f45cf3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:40.492656 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-861c0a51-37f2-4182-8362-fd22b7f45cf3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:40.506784 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-861c0a51-37f2-4182-8362-fd22b7f45cf3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:40.508635 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-861c0a51-37f2-4182-8362-fd22b7f45cf3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:40.510182 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-861c0a51-37f2-4182-8362-fd22b7f45cf3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1671 microversion: 2.20 time: 0.236077 Feb 04 18:11:40.514485 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 547/1086] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:40 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1671 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:41.529786 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-5f981bdd-ed21-410d-b33f-e77ae5f33da7 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:41.531250 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-5f981bdd-ed21-410d-b33f-e77ae5f33da7 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:41.539119 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5f981bdd-ed21-410d-b33f-e77ae5f33da7 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:41.539959 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5f981bdd-ed21-410d-b33f-e77ae5f33da7 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:41.541105 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5f981bdd-ed21-410d-b33f-e77ae5f33da7 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:41.541728 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5f981bdd-ed21-410d-b33f-e77ae5f33da7 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:41.905867 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5f981bdd-ed21-410d-b33f-e77ae5f33da7 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:41.935613 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5f981bdd-ed21-410d-b33f-e77ae5f33da7 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:41.940039 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5f981bdd-ed21-410d-b33f-e77ae5f33da7 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:41.948965 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-5f981bdd-ed21-410d-b33f-e77ae5f33da7 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1727 microversion: 2.20 time: 0.423139 Feb 04 18:11:41.962484 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 540/1087] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:41 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1727 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:42.969506 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-5b212e68-757f-4f2d-a5ea-81c01d33da75 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:42.970306 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-5b212e68-757f-4f2d-a5ea-81c01d33da75 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:42.991969 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5b212e68-757f-4f2d-a5ea-81c01d33da75 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:42.992683 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5b212e68-757f-4f2d-a5ea-81c01d33da75 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:42.993542 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5b212e68-757f-4f2d-a5ea-81c01d33da75 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:42.994140 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5b212e68-757f-4f2d-a5ea-81c01d33da75 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:43.313621 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-5b212e68-757f-4f2d-a5ea-81c01d33da75 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:43.322631 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-5b212e68-757f-4f2d-a5ea-81c01d33da75 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:43.329214 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-5b212e68-757f-4f2d-a5ea-81c01d33da75 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:43.330851 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-5b212e68-757f-4f2d-a5ea-81c01d33da75 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1727 microversion: 2.20 time: 0.365400 Feb 04 18:11:43.347625 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 548/1088] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:42 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1727 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:44.350825 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-23094809-21d5-4e68-825d-450c6d843579 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:44.352078 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-23094809-21d5-4e68-825d-450c6d843579 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:44.360595 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-23094809-21d5-4e68-825d-450c6d843579 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:44.371329 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-23094809-21d5-4e68-825d-450c6d843579 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:44.372499 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-23094809-21d5-4e68-825d-450c6d843579 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:44.373122 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-23094809-21d5-4e68-825d-450c6d843579 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:44.656619 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-23094809-21d5-4e68-825d-450c6d843579 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:44.687266 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-23094809-21d5-4e68-825d-450c6d843579 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:44.698773 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-23094809-21d5-4e68-825d-450c6d843579 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:44.700784 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-23094809-21d5-4e68-825d-450c6d843579 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1727 microversion: 2.20 time: 0.354100 Feb 04 18:11:44.701988 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 541/1089] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:44 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1727 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:45.721226 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-4c4b8270-94c6-4cd3-8b84-772e8cccb441 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:45.722709 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-4c4b8270-94c6-4cd3-8b84-772e8cccb441 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:45.737275 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4c4b8270-94c6-4cd3-8b84-772e8cccb441 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:45.738358 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4c4b8270-94c6-4cd3-8b84-772e8cccb441 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:45.739442 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4c4b8270-94c6-4cd3-8b84-772e8cccb441 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:45.740103 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4c4b8270-94c6-4cd3-8b84-772e8cccb441 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:46.275903 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-4c4b8270-94c6-4cd3-8b84-772e8cccb441 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:46.290043 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-4c4b8270-94c6-4cd3-8b84-772e8cccb441 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:46.293475 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-4c4b8270-94c6-4cd3-8b84-772e8cccb441 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:46.294986 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-4c4b8270-94c6-4cd3-8b84-772e8cccb441 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1727 microversion: 2.20 time: 0.578424 Feb 04 18:11:46.296091 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 549/1090] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:45 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1727 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:47.344523 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c947592f-bffc-46ce-ae17-5a60cf4ed1fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:47.344523 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c947592f-bffc-46ce-ae17-5a60cf4ed1fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:47.344523 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c947592f-bffc-46ce-ae17-5a60cf4ed1fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:47.344523 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c947592f-bffc-46ce-ae17-5a60cf4ed1fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:47.351085 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c947592f-bffc-46ce-ae17-5a60cf4ed1fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:47.352427 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c947592f-bffc-46ce-ae17-5a60cf4ed1fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:48.030492 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c947592f-bffc-46ce-ae17-5a60cf4ed1fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:48.073687 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c947592f-bffc-46ce-ae17-5a60cf4ed1fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:48.076357 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c947592f-bffc-46ce-ae17-5a60cf4ed1fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:48.077455 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c947592f-bffc-46ce-ae17-5a60cf4ed1fa tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1727 microversion: 2.20 time: 0.762825 Feb 04 18:11:48.078879 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 542/1091] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:47 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1727 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:49.106939 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-946ad113-7539-41c3-a07c-3f79829c806e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:49.109137 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-946ad113-7539-41c3-a07c-3f79829c806e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:49.127943 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-946ad113-7539-41c3-a07c-3f79829c806e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:49.129853 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-946ad113-7539-41c3-a07c-3f79829c806e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:49.132522 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-946ad113-7539-41c3-a07c-3f79829c806e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:49.134317 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-946ad113-7539-41c3-a07c-3f79829c806e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:49.451481 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-946ad113-7539-41c3-a07c-3f79829c806e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:49.467909 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-946ad113-7539-41c3-a07c-3f79829c806e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:49.470680 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-946ad113-7539-41c3-a07c-3f79829c806e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:49.472427 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-946ad113-7539-41c3-a07c-3f79829c806e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1727 microversion: 2.20 time: 0.370182 Feb 04 18:11:49.485211 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 550/1092] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:49 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1727 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:50.494928 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-add1c2cb-5cf7-4125-b2a0-f59aea04ded0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:50.497426 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-add1c2cb-5cf7-4125-b2a0-f59aea04ded0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:50.507976 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-add1c2cb-5cf7-4125-b2a0-f59aea04ded0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:50.518616 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-add1c2cb-5cf7-4125-b2a0-f59aea04ded0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:50.521169 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-add1c2cb-5cf7-4125-b2a0-f59aea04ded0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:50.523306 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-add1c2cb-5cf7-4125-b2a0-f59aea04ded0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:50.854051 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-add1c2cb-5cf7-4125-b2a0-f59aea04ded0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:50.862384 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-add1c2cb-5cf7-4125-b2a0-f59aea04ded0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:50.877201 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-add1c2cb-5cf7-4125-b2a0-f59aea04ded0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:50.877201 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-add1c2cb-5cf7-4125-b2a0-f59aea04ded0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1727 microversion: 2.20 time: 0.377597 Feb 04 18:11:50.877201 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 543/1093] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:50 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1727 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:11:51.904733 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-0fa6b184-2a1d-4d9d-8bb7-4040b0fe9d54 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:51.905406 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-0fa6b184-2a1d-4d9d-8bb7-4040b0fe9d54 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:51.920399 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0fa6b184-2a1d-4d9d-8bb7-4040b0fe9d54 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:51.920829 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0fa6b184-2a1d-4d9d-8bb7-4040b0fe9d54 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:51.925087 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0fa6b184-2a1d-4d9d-8bb7-4040b0fe9d54 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:51.926403 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0fa6b184-2a1d-4d9d-8bb7-4040b0fe9d54 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:52.702846 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-0fa6b184-2a1d-4d9d-8bb7-4040b0fe9d54 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:52.712920 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-0fa6b184-2a1d-4d9d-8bb7-4040b0fe9d54 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:52.719382 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-0fa6b184-2a1d-4d9d-8bb7-4040b0fe9d54 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:52.720911 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-0fa6b184-2a1d-4d9d-8bb7-4040b0fe9d54 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1727 microversion: 2.20 time: 0.823010 Feb 04 18:11:52.721650 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 551/1094] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:51 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1727 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:53.782397 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-cf6cdc65-7c8c-4cc2-88c3-7d1e51ddfe19 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:53.782397 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-cf6cdc65-7c8c-4cc2-88c3-7d1e51ddfe19 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:53.782397 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cf6cdc65-7c8c-4cc2-88c3-7d1e51ddfe19 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:53.782397 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cf6cdc65-7c8c-4cc2-88c3-7d1e51ddfe19 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:53.784221 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cf6cdc65-7c8c-4cc2-88c3-7d1e51ddfe19 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:53.784221 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-cf6cdc65-7c8c-4cc2-88c3-7d1e51ddfe19 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:53.994091 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-cf6cdc65-7c8c-4cc2-88c3-7d1e51ddfe19 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:54.008964 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-cf6cdc65-7c8c-4cc2-88c3-7d1e51ddfe19 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:54.010965 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-cf6cdc65-7c8c-4cc2-88c3-7d1e51ddfe19 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:54.012202 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-cf6cdc65-7c8c-4cc2-88c3-7d1e51ddfe19 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1727 microversion: 2.20 time: 0.274869 Feb 04 18:11:54.012775 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 544/1095] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:53 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1727 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:55.030375 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-7871a566-13b1-4609-a2f0-c061cc8e992e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:55.031015 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-7871a566-13b1-4609-a2f0-c061cc8e992e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:55.037397 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7871a566-13b1-4609-a2f0-c061cc8e992e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:55.037856 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7871a566-13b1-4609-a2f0-c061cc8e992e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:55.038675 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7871a566-13b1-4609-a2f0-c061cc8e992e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:55.039141 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7871a566-13b1-4609-a2f0-c061cc8e992e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:55.218554 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-7871a566-13b1-4609-a2f0-c061cc8e992e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:55.227760 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-7871a566-13b1-4609-a2f0-c061cc8e992e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:55.229438 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-7871a566-13b1-4609-a2f0-c061cc8e992e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:55.230787 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-7871a566-13b1-4609-a2f0-c061cc8e992e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1727 microversion: 2.20 time: 0.204208 Feb 04 18:11:55.242678 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 552/1096] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:55 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1727 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:56.249338 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-8d3b2306-799b-4340-9eda-6ad159a9fcc9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:56.250056 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-8d3b2306-799b-4340-9eda-6ad159a9fcc9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:56.257007 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8d3b2306-799b-4340-9eda-6ad159a9fcc9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:56.257544 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8d3b2306-799b-4340-9eda-6ad159a9fcc9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:56.258737 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8d3b2306-799b-4340-9eda-6ad159a9fcc9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:56.259257 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8d3b2306-799b-4340-9eda-6ad159a9fcc9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:56.410778 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-8d3b2306-799b-4340-9eda-6ad159a9fcc9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:56.419257 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-8d3b2306-799b-4340-9eda-6ad159a9fcc9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:56.420833 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-8d3b2306-799b-4340-9eda-6ad159a9fcc9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:56.422014 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-8d3b2306-799b-4340-9eda-6ad159a9fcc9 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1727 microversion: 2.20 time: 0.176639 Feb 04 18:11:56.422790 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 545/1097] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:56 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:57.440796 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-48486054-584a-43f0-bcdb-a1c3416223c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:57.441402 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-48486054-584a-43f0-bcdb-a1c3416223c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:57.449810 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-48486054-584a-43f0-bcdb-a1c3416223c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:57.450253 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-48486054-584a-43f0-bcdb-a1c3416223c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:57.451066 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-48486054-584a-43f0-bcdb-a1c3416223c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:57.451501 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-48486054-584a-43f0-bcdb-a1c3416223c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:57.605237 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-48486054-584a-43f0-bcdb-a1c3416223c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:57.618064 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-48486054-584a-43f0-bcdb-a1c3416223c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:57.620212 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-48486054-584a-43f0-bcdb-a1c3416223c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:57.622643 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-48486054-584a-43f0-bcdb-a1c3416223c5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1727 microversion: 2.20 time: 0.185569 Feb 04 18:11:57.623432 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 553/1098] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:57 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1727 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 04 18:11:57.698060 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-19e16d45-c389-4f0d-a241-e407e404dac3 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Action: 'create', calling method: .version_select at 0x7fe8cc9ac790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1196483484"}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:11:57.719384 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-19e16d45-c389-4f0d-a241-e407e404dac3 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Getting quotas for project 7f2ff016321049ceb841522b8fe2c27a. Resources: {'key_pairs'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:11:57.725329 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-19e16d45-c389-4f0d-a241-e407e404dac3 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Getting quotas for user 508cd118fbdd432491f2e778e789473d and project 7f2ff016321049ceb841522b8fe2c27a. Resources: {'key_pairs'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:11:58.031470 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-19e16d45-c389-4f0d-a241-e407e404dac3 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Getting quotas for project 7f2ff016321049ceb841522b8fe2c27a. Resources: {'key_pairs'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:11:58.036308 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-19e16d45-c389-4f0d-a241-e407e404dac3 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Getting quotas for user 508cd118fbdd432491f2e778e789473d and project 7f2ff016321049ceb841522b8fe2c27a. Resources: {'key_pairs'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:11:58.057471 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-19e16d45-c389-4f0d-a241-e407e404dac3 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.562075 Feb 04 18:11:58.062110 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 546/1099] 10.222.0.98 () {60 vars in 1157 bytes} [Fri Feb 4 18:11:57 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:11:58.641528 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-49d4e79f-0dcd-41dc-b221-6d78b43f673f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:58.642223 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-49d4e79f-0dcd-41dc-b221-6d78b43f673f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:58.649705 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-49d4e79f-0dcd-41dc-b221-6d78b43f673f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:58.650156 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-49d4e79f-0dcd-41dc-b221-6d78b43f673f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:58.651005 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-49d4e79f-0dcd-41dc-b221-6d78b43f673f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:58.651452 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-49d4e79f-0dcd-41dc-b221-6d78b43f673f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:58.805238 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-49d4e79f-0dcd-41dc-b221-6d78b43f673f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:58.814160 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-49d4e79f-0dcd-41dc-b221-6d78b43f673f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:58.815915 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-49d4e79f-0dcd-41dc-b221-6d78b43f673f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:11:58.817260 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-49d4e79f-0dcd-41dc-b221-6d78b43f673f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1727 microversion: 2.20 time: 0.179563 Feb 04 18:11:58.822648 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 554/1100] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:58 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1727 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:11:59.839949 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-ca417686-453e-4564-917d-b10ebb7ddf26 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:11:59.842003 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-ca417686-453e-4564-917d-b10ebb7ddf26 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:11:59.853107 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ca417686-453e-4564-917d-b10ebb7ddf26 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:59.854871 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ca417686-453e-4564-917d-b10ebb7ddf26 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:11:59.859935 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ca417686-453e-4564-917d-b10ebb7ddf26 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:11:59.861231 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-ca417686-453e-4564-917d-b10ebb7ddf26 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:00.049974 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ca417686-453e-4564-917d-b10ebb7ddf26 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:00.063746 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ca417686-453e-4564-917d-b10ebb7ddf26 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:00.065270 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-ca417686-453e-4564-917d-b10ebb7ddf26 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:00.066842 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-ca417686-453e-4564-917d-b10ebb7ddf26 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1727 microversion: 2.20 time: 0.234452 Feb 04 18:12:00.067667 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 547/1101] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:11:59 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1727 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:12:01.085119 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-87d21b3b-3b0f-4084-a192-e57e39a8a4fc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:01.085728 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-87d21b3b-3b0f-4084-a192-e57e39a8a4fc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:01.091994 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-87d21b3b-3b0f-4084-a192-e57e39a8a4fc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:01.093908 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-87d21b3b-3b0f-4084-a192-e57e39a8a4fc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:01.093908 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-87d21b3b-3b0f-4084-a192-e57e39a8a4fc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:01.093908 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-87d21b3b-3b0f-4084-a192-e57e39a8a4fc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:01.279404 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-87d21b3b-3b0f-4084-a192-e57e39a8a4fc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:01.284531 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-87d21b3b-3b0f-4084-a192-e57e39a8a4fc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:01.286031 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-87d21b3b-3b0f-4084-a192-e57e39a8a4fc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:01.287795 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-87d21b3b-3b0f-4084-a192-e57e39a8a4fc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1727 microversion: 2.20 time: 0.205892 Feb 04 18:12:01.288318 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 555/1102] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:12:01 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1727 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:12:02.182548 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-58dfbd47-b82a-4361-a4de-8ceb3ede7cf1 req-a973c21e-4d7a-45ef-8bb2-d65dc9cc2a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32416d02-187d-4d8f-9698-d36ac5ffbc26", "name": "network-vif-plugged", "status": "completed", "tag": "8dbc5ea2-225d-4915-8e59-f39e014f906a"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:12:02.185457 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:12:02.185457 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:12:02.190780 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-58dfbd47-b82a-4361-a4de-8ceb3ede7cf1 req-a973c21e-4d7a-45ef-8bb2-d65dc9cc2a73 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:02.191225 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-58dfbd47-b82a-4361-a4de-8ceb3ede7cf1 req-a973c21e-4d7a-45ef-8bb2-d65dc9cc2a73 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:02.202384 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-58dfbd47-b82a-4361-a4de-8ceb3ede7cf1 req-a973c21e-4d7a-45ef-8bb2-d65dc9cc2a73 service nova] Creating event network-vif-plugged:8dbc5ea2-225d-4915-8e59-f39e014f906a for instance 32416d02-187d-4d8f-9698-d36ac5ffbc26 on hv-cinder-82276 Feb 04 18:12:02.207580 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-58dfbd47-b82a-4361-a4de-8ceb3ede7cf1 req-a973c21e-4d7a-45ef-8bb2-d65dc9cc2a73 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084587 Feb 04 18:12:02.208167 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 548/1103] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:12:02.305265 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-737d97b3-8c3a-4c2a-b90d-cbc2ab9334bc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:02.305879 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-737d97b3-8c3a-4c2a-b90d-cbc2ab9334bc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:02.311975 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-737d97b3-8c3a-4c2a-b90d-cbc2ab9334bc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:02.312436 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-737d97b3-8c3a-4c2a-b90d-cbc2ab9334bc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:02.313369 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-737d97b3-8c3a-4c2a-b90d-cbc2ab9334bc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:02.313658 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-737d97b3-8c3a-4c2a-b90d-cbc2ab9334bc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:02.462885 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-737d97b3-8c3a-4c2a-b90d-cbc2ab9334bc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:02.472279 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-737d97b3-8c3a-4c2a-b90d-cbc2ab9334bc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:02.473856 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-737d97b3-8c3a-4c2a-b90d-cbc2ab9334bc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:02.475125 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-737d97b3-8c3a-4c2a-b90d-cbc2ab9334bc tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1727 microversion: 2.20 time: 0.173994 Feb 04 18:12:02.475695 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 556/1104] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:12:02 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:12:03.496329 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-f5bfe46f-5633-4e69-a681-f8570aa3013e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:03.497060 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-f5bfe46f-5633-4e69-a681-f8570aa3013e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:03.507957 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f5bfe46f-5633-4e69-a681-f8570aa3013e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:03.508415 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f5bfe46f-5633-4e69-a681-f8570aa3013e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:03.509210 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f5bfe46f-5633-4e69-a681-f8570aa3013e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:03.509685 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f5bfe46f-5633-4e69-a681-f8570aa3013e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:03.647826 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-f5bfe46f-5633-4e69-a681-f8570aa3013e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:03.655943 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-f5bfe46f-5633-4e69-a681-f8570aa3013e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:03.657455 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-f5bfe46f-5633-4e69-a681-f8570aa3013e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:03.658697 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-f5bfe46f-5633-4e69-a681-f8570aa3013e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1727 microversion: 2.20 time: 0.168211 Feb 04 18:12:03.659269 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 549/1105] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:12:03 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:12:04.676980 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-f3a07609-bcd9-45e5-8b15-37f18d0bb1c3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:04.677532 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-f3a07609-bcd9-45e5-8b15-37f18d0bb1c3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:04.683990 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f3a07609-bcd9-45e5-8b15-37f18d0bb1c3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:04.685955 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f3a07609-bcd9-45e5-8b15-37f18d0bb1c3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:04.685955 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f3a07609-bcd9-45e5-8b15-37f18d0bb1c3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:04.685955 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f3a07609-bcd9-45e5-8b15-37f18d0bb1c3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:04.828912 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-f3a07609-bcd9-45e5-8b15-37f18d0bb1c3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:04.837472 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-f3a07609-bcd9-45e5-8b15-37f18d0bb1c3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:04.839039 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-f3a07609-bcd9-45e5-8b15-37f18d0bb1c3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:04.840202 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-f3a07609-bcd9-45e5-8b15-37f18d0bb1c3 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1727 microversion: 2.20 time: 0.167038 Feb 04 18:12:04.840757 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 557/1106] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:12:04 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:12:05.858688 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-82d36252-5c0d-4229-a400-1bd436372b3f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:05.859416 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-82d36252-5c0d-4229-a400-1bd436372b3f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:05.865969 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-82d36252-5c0d-4229-a400-1bd436372b3f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:05.866569 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-82d36252-5c0d-4229-a400-1bd436372b3f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:05.868172 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-82d36252-5c0d-4229-a400-1bd436372b3f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:05.868753 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-82d36252-5c0d-4229-a400-1bd436372b3f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:06.007113 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-82d36252-5c0d-4229-a400-1bd436372b3f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:06.015119 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-82d36252-5c0d-4229-a400-1bd436372b3f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:06.016627 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-82d36252-5c0d-4229-a400-1bd436372b3f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:06.017800 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-82d36252-5c0d-4229-a400-1bd436372b3f tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1727 microversion: 2.20 time: 0.162970 Feb 04 18:12:06.018362 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 550/1107] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:12:05 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:12:07.036595 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-97dedc92-8b04-40ae-82f3-89fc5f621a49 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:07.037202 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-97dedc92-8b04-40ae-82f3-89fc5f621a49 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:07.043570 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-97dedc92-8b04-40ae-82f3-89fc5f621a49 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:07.044016 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-97dedc92-8b04-40ae-82f3-89fc5f621a49 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:07.044786 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-97dedc92-8b04-40ae-82f3-89fc5f621a49 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:07.045215 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-97dedc92-8b04-40ae-82f3-89fc5f621a49 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:07.183017 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-97dedc92-8b04-40ae-82f3-89fc5f621a49 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:07.191219 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-97dedc92-8b04-40ae-82f3-89fc5f621a49 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:07.192715 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-97dedc92-8b04-40ae-82f3-89fc5f621a49 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:07.193861 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-97dedc92-8b04-40ae-82f3-89fc5f621a49 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1714 microversion: 2.20 time: 0.161004 Feb 04 18:12:07.197897 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 558/1108] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:12:07 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1714 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:12:12.537232 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-2b386f23-2ad4-462b-bdc8-653614e615cc tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:12.538154 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-2b386f23-2ad4-462b-bdc8-653614e615cc tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:12.545204 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2b386f23-2ad4-462b-bdc8-653614e615cc tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:12.545659 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2b386f23-2ad4-462b-bdc8-653614e615cc tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:12.546455 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2b386f23-2ad4-462b-bdc8-653614e615cc tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:12.546899 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2b386f23-2ad4-462b-bdc8-653614e615cc tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:12.579026 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-2b386f23-2ad4-462b-bdc8-653614e615cc tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045467 Feb 04 18:12:12.579850 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 551/1109] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:12:12 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 04 18:12:12.635372 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-4698bea5-f6d4-4a70-bba5-83bcfb246d50 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:12.635995 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-4698bea5-f6d4-4a70-bba5-83bcfb246d50 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:12.643243 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4698bea5-f6d4-4a70-bba5-83bcfb246d50 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:12.643744 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4698bea5-f6d4-4a70-bba5-83bcfb246d50 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:12.644495 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4698bea5-f6d4-4a70-bba5-83bcfb246d50 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:12.644945 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4698bea5-f6d4-4a70-bba5-83bcfb246d50 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:12.673117 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-4698bea5-f6d4-4a70-bba5-83bcfb246d50 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Going to try to terminate instance {{(pid=123566) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 04 18:12:13.023095 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-4698bea5-f6d4-4a70-bba5-83bcfb246d50 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "DELETE /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 204 len: 0 microversion: 2.1 time: 0.391631 Feb 04 18:12:13.023680 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 559/1110] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Feb 4 18:12:12 2022] DELETE /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 04 18:12:13.032198 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a283b2a8-f86e-4058-ab85-c6b9acdf79f1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:13.032818 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-a283b2a8-f86e-4058-ab85-c6b9acdf79f1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:13.038994 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a283b2a8-f86e-4058-ab85-c6b9acdf79f1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:13.039453 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a283b2a8-f86e-4058-ab85-c6b9acdf79f1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:13.040238 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a283b2a8-f86e-4058-ab85-c6b9acdf79f1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:13.040683 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a283b2a8-f86e-4058-ab85-c6b9acdf79f1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:13.178331 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-a283b2a8-f86e-4058-ab85-c6b9acdf79f1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:13.185708 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a283b2a8-f86e-4058-ab85-c6b9acdf79f1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1673 microversion: 2.1 time: 0.157260 Feb 04 18:12:13.186275 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 552/1111] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:13 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:14.203049 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-342c6e66-d42c-4cd6-963e-b54734f7132b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:14.203891 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-342c6e66-d42c-4cd6-963e-b54734f7132b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:14.210692 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-342c6e66-d42c-4cd6-963e-b54734f7132b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:14.211160 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-342c6e66-d42c-4cd6-963e-b54734f7132b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:14.211916 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-342c6e66-d42c-4cd6-963e-b54734f7132b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:14.212344 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-342c6e66-d42c-4cd6-963e-b54734f7132b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:14.351651 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-342c6e66-d42c-4cd6-963e-b54734f7132b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:14.359615 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-342c6e66-d42c-4cd6-963e-b54734f7132b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1673 microversion: 2.1 time: 0.160789 Feb 04 18:12:14.360218 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 560/1112] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:14 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:15.377717 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-68acad2d-a415-4eae-8b10-d6bdc4c608ed tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:15.378348 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-68acad2d-a415-4eae-8b10-d6bdc4c608ed tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:15.384693 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-68acad2d-a415-4eae-8b10-d6bdc4c608ed tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:15.385139 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-68acad2d-a415-4eae-8b10-d6bdc4c608ed tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:15.385920 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-68acad2d-a415-4eae-8b10-d6bdc4c608ed tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:15.386384 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-68acad2d-a415-4eae-8b10-d6bdc4c608ed tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:15.448560 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-68acad2d-a415-4eae-8b10-d6bdc4c608ed tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:15.456066 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-68acad2d-a415-4eae-8b10-d6bdc4c608ed tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1605 microversion: 2.1 time: 0.082067 Feb 04 18:12:15.456634 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 553/1113] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:15 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1605 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:15.824395 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-cba0df08-4fe4-4d15-a2f2-f6150ab11cf7 req-1d29f26b-8e10-44b4-bffc-e2e2e5e633ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "629aebef-875d-4e7d-b9e6-ab8e0195d62c", "name": "network-vif-deleted", "tag": "b2d5a9ae-dcf1-4e21-87cf-e3e8e1606141"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:12:15.826126 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:12:15.826126 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:12:15.833962 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-cba0df08-4fe4-4d15-a2f2-f6150ab11cf7 req-1d29f26b-8e10-44b4-bffc-e2e2e5e633ae service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:15.834767 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-cba0df08-4fe4-4d15-a2f2-f6150ab11cf7 req-1d29f26b-8e10-44b4-bffc-e2e2e5e633ae service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:15.870401 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-cba0df08-4fe4-4d15-a2f2-f6150ab11cf7 req-1d29f26b-8e10-44b4-bffc-e2e2e5e633ae service nova] Creating event network-vif-deleted:b2d5a9ae-dcf1-4e21-87cf-e3e8e1606141 for instance 629aebef-875d-4e7d-b9e6-ab8e0195d62c on hv-cinder-82276 Feb 04 18:12:15.879630 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-cba0df08-4fe4-4d15-a2f2-f6150ab11cf7 req-1d29f26b-8e10-44b4-bffc-e2e2e5e633ae service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125832 Feb 04 18:12:15.886149 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 561/1114] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:12:16.472985 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b2db5675-6bfd-4220-bf14-18e4d0885c64 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:16.473609 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-b2db5675-6bfd-4220-bf14-18e4d0885c64 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:16.480290 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b2db5675-6bfd-4220-bf14-18e4d0885c64 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:16.480756 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b2db5675-6bfd-4220-bf14-18e4d0885c64 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:16.481553 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b2db5675-6bfd-4220-bf14-18e4d0885c64 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:16.481997 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b2db5675-6bfd-4220-bf14-18e4d0885c64 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:16.519356 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b2db5675-6bfd-4220-bf14-18e4d0885c64 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:16.519822 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b2db5675-6bfd-4220-bf14-18e4d0885c64 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:16.520290 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.objects.instance [None req-b2db5675-6bfd-4220-bf14-18e4d0885c64 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lazy-loading 'fault' on Instance uuid 629aebef-875d-4e7d-b9e6-ab8e0195d62c {{(pid=123567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:12:16.565958 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-b2db5675-6bfd-4220-bf14-18e4d0885c64 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:16.574346 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b2db5675-6bfd-4220-bf14-18e4d0885c64 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 200 len: 1326 microversion: 2.1 time: 0.104955 Feb 04 18:12:16.575381 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 554/1115] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:16 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 1326 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:17.593513 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-3cc71f3d-14b0-4776-acbd-2ef3cf3b3709 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:17.594220 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-3cc71f3d-14b0-4776-acbd-2ef3cf3b3709 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:17.600688 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3cc71f3d-14b0-4776-acbd-2ef3cf3b3709 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:17.601137 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3cc71f3d-14b0-4776-acbd-2ef3cf3b3709 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:17.601914 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3cc71f3d-14b0-4776-acbd-2ef3cf3b3709 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:17.602346 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3cc71f3d-14b0-4776-acbd-2ef3cf3b3709 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:17.615718 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-3cc71f3d-14b0-4776-acbd-2ef3cf3b3709 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] HTTP exception thrown: Instance 629aebef-875d-4e7d-b9e6-ab8e0195d62c could not be found. Feb 04 18:12:17.616355 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-3cc71f3d-14b0-4776-acbd-2ef3cf3b3709 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Returning 404 to user: Instance 629aebef-875d-4e7d-b9e6-ab8e0195d62c could not be found. {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:12:17.617176 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-3cc71f3d-14b0-4776-acbd-2ef3cf3b3709 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 404 len: 111 microversion: 2.1 time: 0.028861 Feb 04 18:12:17.617717 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 562/1116] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:17 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:12:17.626081 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b5521f4c-00c6-49f3-ba7e-370643af509e tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '.version_select at 0x7fe8cc9ac040>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:17.709896 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b5521f4c-00c6-49f3-ba7e-370643af509e tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-873337665" status: 202 len: 0 microversion: 2.1 time: 0.087382 Feb 04 18:12:17.710517 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 555/1117] 10.222.0.98 () {58 vars in 1217 bytes} [Fri Feb 4 18:12:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-873337665 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 04 18:12:18.544632 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b909a923-7221-4984-991c-b2e2823c4008 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Action: 'create', calling method: .version_select at 0x7fe8bffaadc0>, body: {"keypair": {"name": "tempest-keypair-1696882358"}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:12:18.562053 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-b909a923-7221-4984-991c-b2e2823c4008 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Getting quotas for project ac0ec68d2c474dbf8c692e362abd93cb. Resources: {'key_pairs'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:12:18.566661 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-b909a923-7221-4984-991c-b2e2823c4008 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Getting quotas for user b75ec1e932d7429a9319213a04eb7766 and project ac0ec68d2c474dbf8c692e362abd93cb. Resources: {'key_pairs'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:12:19.037735 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-b909a923-7221-4984-991c-b2e2823c4008 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Getting quotas for project ac0ec68d2c474dbf8c692e362abd93cb. Resources: {'key_pairs'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:12:19.042232 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-b909a923-7221-4984-991c-b2e2823c4008 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Getting quotas for user b75ec1e932d7429a9319213a04eb7766 and project ac0ec68d2c474dbf8c692e362abd93cb. Resources: {'key_pairs'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:12:19.055653 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-b909a923-7221-4984-991c-b2e2823c4008 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.515243 Feb 04 18:12:19.056247 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 563/1118] 10.222.0.98 () {60 vars in 1157 bytes} [Fri Feb 4 18:12:18 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:21.703507 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-1120e6ce-9117-4bc7-b88b-cfd1a86cfac9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1927350899", "imageRef": "b0fb57f5-967d-4692-94f3-accee37910c3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad908c4b-c2c9-46d5-a416-1e7a31ac0b31"}], "security_groups": [{"name": "tempest-securitygroup--349399400"}], "key_name": "tempest-keypair-1696882358", "user_data": "}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:12:21.804764 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.network.neutron [None req-1120e6ce-9117-4bc7-b88b-cfd1a86cfac9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] validate_networks() for [('ad908c4b-c2c9-46d5-a416-1e7a31ac0b31', None, None, None, None, None)] {{(pid=123567) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 04 18:12:22.283261 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-1120e6ce-9117-4bc7-b88b-cfd1a86cfac9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Flavor limits 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 04 18:12:22.283688 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-1120e6ce-9117-4bc7-b88b-cfd1a86cfac9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Image limits 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 04 18:12:22.284164 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-1120e6ce-9117-4bc7-b88b-cfd1a86cfac9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Flavor pref 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 04 18:12:22.284577 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-1120e6ce-9117-4bc7-b88b-cfd1a86cfac9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Image pref 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 04 18:12:22.284992 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-1120e6ce-9117-4bc7-b88b-cfd1a86cfac9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 04 18:12:22.294929 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1120e6ce-9117-4bc7-b88b-cfd1a86cfac9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:22.295416 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1120e6ce-9117-4bc7-b88b-cfd1a86cfac9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:22.296235 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1120e6ce-9117-4bc7-b88b-cfd1a86cfac9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:22.296684 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1120e6ce-9117-4bc7-b88b-cfd1a86cfac9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:22.315276 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-1120e6ce-9117-4bc7-b88b-cfd1a86cfac9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Getting quotas for project ac0ec68d2c474dbf8c692e362abd93cb. Resources: {'cores', 'ram', 'instances'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:12:22.319504 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-1120e6ce-9117-4bc7-b88b-cfd1a86cfac9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Getting quotas for user b75ec1e932d7429a9319213a04eb7766 and project ac0ec68d2c474dbf8c692e362abd93cb. Resources: {'cores', 'ram', 'instances'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:12:22.331809 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-1120e6ce-9117-4bc7-b88b-cfd1a86cfac9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Going to run 1 instances... {{(pid=123567) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 04 18:12:22.334221 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-1120e6ce-9117-4bc7-b88b-cfd1a86cfac9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0fb57f5-967d-4692-94f3-accee37910c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 04 18:12:22.475972 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-1120e6ce-9117-4bc7-b88b-cfd1a86cfac9 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.778245 Feb 04 18:12:22.476636 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 556/1119] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Feb 4 18:12:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 04 18:12:22.486811 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-9947cf9a-deb7-4193-9a4b-3a3629058e25 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:22.487699 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-9947cf9a-deb7-4193-9a4b-3a3629058e25 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:22.543779 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-9947cf9a-deb7-4193-9a4b-3a3629058e25 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:22.550275 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-9947cf9a-deb7-4193-9a4b-3a3629058e25 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 200 len: 1238 microversion: 2.1 time: 0.067611 Feb 04 18:12:22.550874 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 564/1120] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:22 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:23.568282 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b65a2c84-eeab-4585-a7f7-5a063072bd53 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:23.568930 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-b65a2c84-eeab-4585-a7f7-5a063072bd53 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:23.626973 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-b65a2c84-eeab-4585-a7f7-5a063072bd53 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:23.634633 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b65a2c84-eeab-4585-a7f7-5a063072bd53 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 200 len: 1238 microversion: 2.1 time: 0.070545 Feb 04 18:12:23.635226 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 557/1121] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:23 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:24.653052 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-77ffa62e-67cd-4114-a04e-8c12724a4c63 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:24.654439 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-77ffa62e-67cd-4114-a04e-8c12724a4c63 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:24.715404 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-77ffa62e-67cd-4114-a04e-8c12724a4c63 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:24.722581 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-77ffa62e-67cd-4114-a04e-8c12724a4c63 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 200 len: 1238 microversion: 2.1 time: 0.074296 Feb 04 18:12:24.723147 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 565/1122] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:24 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:25.740335 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-5d804854-028e-4342-ad6d-84d1416dec26 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:25.741012 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-5d804854-028e-4342-ad6d-84d1416dec26 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:25.787896 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 04 18:12:25.788482 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: Fri Feb 4 18:12:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 04 18:12:25.793890 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5d804854-028e-4342-ad6d-84d1416dec26 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:25.800569 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-5d804854-028e-4342-ad6d-84d1416dec26 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 200 len: 1238 microversion: 2.1 time: 0.064127 Feb 04 18:12:25.801144 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 558/1123] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:25 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 1238 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:26.817740 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-98083e25-f422-4e08-bd1c-3f8f483496f3 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:26.818351 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-98083e25-f422-4e08-bd1c-3f8f483496f3 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:26.825346 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-98083e25-f422-4e08-bd1c-3f8f483496f3 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:26.825798 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-98083e25-f422-4e08-bd1c-3f8f483496f3 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:26.826618 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-98083e25-f422-4e08-bd1c-3f8f483496f3 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:26.827063 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-98083e25-f422-4e08-bd1c-3f8f483496f3 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:26.888915 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-98083e25-f422-4e08-bd1c-3f8f483496f3 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:26.896401 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-98083e25-f422-4e08-bd1c-3f8f483496f3 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 200 len: 1242 microversion: 2.1 time: 0.082293 Feb 04 18:12:26.896962 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 566/1124] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:26 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:27.756785 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-7d2dd82c-a086-4f67-8f1a-627905a69d77 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2044762186", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1196483484", "security_groups": [{"name": "tempest-secgroup-smoke-453985264"}], "block_device_mapping_v2": [{"uuid": "b2201eab-22f0-4783-be09-4f9c2234d8d7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c2f9ed8d-fda8-42c7-8ea1-cd07bcb8b632"}]}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:12:27.866733 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.network.neutron [None req-7d2dd82c-a086-4f67-8f1a-627905a69d77 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] validate_networks() for [('c2f9ed8d-fda8-42c7-8ea1-cd07bcb8b632', None, None, None, None, None)] {{(pid=123567) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 04 18:12:27.913265 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-a13f6053-471b-4cd9-81d6-bc13a19c7930 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:27.914033 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-a13f6053-471b-4cd9-81d6-bc13a19c7930 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:27.921826 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a13f6053-471b-4cd9-81d6-bc13a19c7930 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:27.921826 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a13f6053-471b-4cd9-81d6-bc13a19c7930 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:27.922537 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a13f6053-471b-4cd9-81d6-bc13a19c7930 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:27.922991 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a13f6053-471b-4cd9-81d6-bc13a19c7930 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:28.001571 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-a13f6053-471b-4cd9-81d6-bc13a19c7930 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:28.009345 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-a13f6053-471b-4cd9-81d6-bc13a19c7930 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 200 len: 1242 microversion: 2.1 time: 0.099890 Feb 04 18:12:28.009946 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 567/1125] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:27 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 1242 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:12:28.275459 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-7d2dd82c-a086-4f67-8f1a-627905a69d77 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Flavor limits 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 04 18:12:28.275892 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-7d2dd82c-a086-4f67-8f1a-627905a69d77 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Image limits 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 04 18:12:28.276372 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-7d2dd82c-a086-4f67-8f1a-627905a69d77 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Flavor pref 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 04 18:12:28.276789 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-7d2dd82c-a086-4f67-8f1a-627905a69d77 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Image pref 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 04 18:12:28.277334 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-7d2dd82c-a086-4f67-8f1a-627905a69d77 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 04 18:12:28.286111 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7d2dd82c-a086-4f67-8f1a-627905a69d77 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:28.286617 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7d2dd82c-a086-4f67-8f1a-627905a69d77 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:28.287427 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7d2dd82c-a086-4f67-8f1a-627905a69d77 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:28.287872 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7d2dd82c-a086-4f67-8f1a-627905a69d77 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:28.306037 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-7d2dd82c-a086-4f67-8f1a-627905a69d77 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Getting quotas for project 7f2ff016321049ceb841522b8fe2c27a. Resources: {'cores', 'ram', 'instances'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:12:28.310544 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-7d2dd82c-a086-4f67-8f1a-627905a69d77 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Getting quotas for user 508cd118fbdd432491f2e778e789473d and project 7f2ff016321049ceb841522b8fe2c27a. Resources: {'cores', 'ram', 'instances'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:12:28.366348 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-7d2dd82c-a086-4f67-8f1a-627905a69d77 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Going to run 1 instances... {{(pid=123567) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 04 18:12:28.368420 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-7d2dd82c-a086-4f67-8f1a-627905a69d77 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b2201eab-22f0-4783-be09-4f9c2234d8d7',volume_size=None,volume_type=None)] {{(pid=123567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 04 18:12:29.026257 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-1af2e04a-d5aa-4a95-a557-5c0329c91576 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:29.026927 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-1af2e04a-d5aa-4a95-a557-5c0329c91576 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:29.030602 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-7d2dd82c-a086-4f67-8f1a-627905a69d77 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.277990 Feb 04 18:12:29.031303 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 559/1126] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Feb 4 18:12:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 04 18:12:29.034777 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1af2e04a-d5aa-4a95-a557-5c0329c91576 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:29.036710 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1af2e04a-d5aa-4a95-a557-5c0329c91576 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:29.036710 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1af2e04a-d5aa-4a95-a557-5c0329c91576 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:29.037145 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1af2e04a-d5aa-4a95-a557-5c0329c91576 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:29.041225 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c0362cb8-7848-4d2b-88e0-d17bcecab6af tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:29.041990 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c0362cb8-7848-4d2b-88e0-d17bcecab6af tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:29.098397 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c0362cb8-7848-4d2b-88e0-d17bcecab6af tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:29.108132 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c0362cb8-7848-4d2b-88e0-d17bcecab6af tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1095 microversion: 2.1 time: 0.070238 Feb 04 18:12:29.108749 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 560/1127] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:29 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:12:29.131606 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-1af2e04a-d5aa-4a95-a557-5c0329c91576 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:29.135825 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-1af2e04a-d5aa-4a95-a557-5c0329c91576 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 200 len: 1290 microversion: 2.1 time: 0.113155 Feb 04 18:12:29.136626 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 568/1128] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:29 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 1290 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:12:30.125117 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c6594cd8-b7d8-4bd9-989e-a8f111ec5641 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:30.125757 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c6594cd8-b7d8-4bd9-989e-a8f111ec5641 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:30.153438 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-70d8463a-ee06-477e-ba0b-f33e13c60d8b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:30.167775 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-70d8463a-ee06-477e-ba0b-f33e13c60d8b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:30.167775 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-70d8463a-ee06-477e-ba0b-f33e13c60d8b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:30.167775 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-70d8463a-ee06-477e-ba0b-f33e13c60d8b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:30.167775 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-70d8463a-ee06-477e-ba0b-f33e13c60d8b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:30.168796 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-70d8463a-ee06-477e-ba0b-f33e13c60d8b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:30.185396 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c6594cd8-b7d8-4bd9-989e-a8f111ec5641 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:30.195001 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c6594cd8-b7d8-4bd9-989e-a8f111ec5641 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1095 microversion: 2.1 time: 0.073661 Feb 04 18:12:30.195585 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 561/1129] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:30 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:30.226769 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-70d8463a-ee06-477e-ba0b-f33e13c60d8b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:30.235074 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-70d8463a-ee06-477e-ba0b-f33e13c60d8b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 200 len: 1296 microversion: 2.1 time: 0.085791 Feb 04 18:12:30.235649 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 569/1130] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:30 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 1296 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:12:31.219782 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-44ede8c4-373d-4a3c-b6a0-51c2f84a6c02 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:31.220481 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-44ede8c4-373d-4a3c-b6a0-51c2f84a6c02 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:31.227278 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-44ede8c4-373d-4a3c-b6a0-51c2f84a6c02 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:31.227725 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-44ede8c4-373d-4a3c-b6a0-51c2f84a6c02 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:31.228512 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-44ede8c4-373d-4a3c-b6a0-51c2f84a6c02 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:31.228949 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-44ede8c4-373d-4a3c-b6a0-51c2f84a6c02 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:31.260055 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ce69093d-7235-4ac7-a50c-cd2265ae7b52 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:31.260759 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ce69093d-7235-4ac7-a50c-cd2265ae7b52 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:31.274409 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ce69093d-7235-4ac7-a50c-cd2265ae7b52 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:31.274887 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ce69093d-7235-4ac7-a50c-cd2265ae7b52 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:31.280310 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ce69093d-7235-4ac7-a50c-cd2265ae7b52 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:31.294569 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ce69093d-7235-4ac7-a50c-cd2265ae7b52 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:31.307499 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-44ede8c4-373d-4a3c-b6a0-51c2f84a6c02 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:31.317422 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-44ede8c4-373d-4a3c-b6a0-51c2f84a6c02 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1137 microversion: 2.1 time: 0.101223 Feb 04 18:12:31.328951 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 562/1131] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:31 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1137 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:31.435894 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-ce69093d-7235-4ac7-a50c-cd2265ae7b52 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:31.443620 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ce69093d-7235-4ac7-a50c-cd2265ae7b52 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 200 len: 1363 microversion: 2.1 time: 0.187292 Feb 04 18:12:31.444516 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 570/1132] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:31 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:31.731220 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-76e7d98d-72b7-4f5d-bb88-8acdc2871da7 req-6d0451e6-b591-42fa-9301-15253b33a43e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdbc5838-213f-4ce8-8628-2c180bc6b92c", "tag": "1185b4cf-af56-43d5-94d4-dd578ae69eac"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:12:31.732868 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:12:31.732868 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:12:31.740983 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-76e7d98d-72b7-4f5d-bb88-8acdc2871da7 req-6d0451e6-b591-42fa-9301-15253b33a43e service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:31.741427 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-76e7d98d-72b7-4f5d-bb88-8acdc2871da7 req-6d0451e6-b591-42fa-9301-15253b33a43e service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:31.759049 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-76e7d98d-72b7-4f5d-bb88-8acdc2871da7 req-6d0451e6-b591-42fa-9301-15253b33a43e service nova] Creating event network-changed:1185b4cf-af56-43d5-94d4-dd578ae69eac for instance fdbc5838-213f-4ce8-8628-2c180bc6b92c on hv-cinder-82276 Feb 04 18:12:31.764995 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-76e7d98d-72b7-4f5d-bb88-8acdc2871da7 req-6d0451e6-b591-42fa-9301-15253b33a43e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038646 Feb 04 18:12:31.765894 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 563/1133] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:12:32.335354 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-dabfe909-afd1-4121-9a6f-6353542eb60e tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:32.335996 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-dabfe909-afd1-4121-9a6f-6353542eb60e tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:32.342540 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dabfe909-afd1-4121-9a6f-6353542eb60e tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:32.342975 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dabfe909-afd1-4121-9a6f-6353542eb60e tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:32.343791 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dabfe909-afd1-4121-9a6f-6353542eb60e tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:32.344223 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dabfe909-afd1-4121-9a6f-6353542eb60e tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:32.412532 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-dabfe909-afd1-4121-9a6f-6353542eb60e tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:32.420507 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-dabfe909-afd1-4121-9a6f-6353542eb60e tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1201 microversion: 2.1 time: 0.088682 Feb 04 18:12:32.429775 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 571/1134] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:32 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1201 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:32.462158 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-caf815a0-e5fa-429e-9e8b-48a6ccc59ae5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:32.462935 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-caf815a0-e5fa-429e-9e8b-48a6ccc59ae5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:32.469871 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-caf815a0-e5fa-429e-9e8b-48a6ccc59ae5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:32.470445 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-caf815a0-e5fa-429e-9e8b-48a6ccc59ae5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:32.471246 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-caf815a0-e5fa-429e-9e8b-48a6ccc59ae5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:32.471683 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-caf815a0-e5fa-429e-9e8b-48a6ccc59ae5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:32.614092 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-caf815a0-e5fa-429e-9e8b-48a6ccc59ae5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:32.622214 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-caf815a0-e5fa-429e-9e8b-48a6ccc59ae5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 200 len: 1363 microversion: 2.1 time: 0.164508 Feb 04 18:12:32.622846 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 564/1135] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:32 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:33.437135 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-fcd8b820-44d5-40e9-a0e3-679cbd00cfcb tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:33.437862 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-fcd8b820-44d5-40e9-a0e3-679cbd00cfcb tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:33.444523 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fcd8b820-44d5-40e9-a0e3-679cbd00cfcb tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:33.445051 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fcd8b820-44d5-40e9-a0e3-679cbd00cfcb tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:33.445966 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fcd8b820-44d5-40e9-a0e3-679cbd00cfcb tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:33.446569 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-fcd8b820-44d5-40e9-a0e3-679cbd00cfcb tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:33.614726 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-fcd8b820-44d5-40e9-a0e3-679cbd00cfcb tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:33.626535 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-fcd8b820-44d5-40e9-a0e3-679cbd00cfcb tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1278 microversion: 2.1 time: 0.192915 Feb 04 18:12:33.627354 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 572/1136] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:33 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1278 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:33.639900 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-f6473763-d060-4d0f-9c80-561ddcc32cec tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:33.640515 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-f6473763-d060-4d0f-9c80-561ddcc32cec tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:33.647130 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f6473763-d060-4d0f-9c80-561ddcc32cec tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:33.647589 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f6473763-d060-4d0f-9c80-561ddcc32cec tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:33.648393 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f6473763-d060-4d0f-9c80-561ddcc32cec tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:33.648902 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f6473763-d060-4d0f-9c80-561ddcc32cec tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:33.799629 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-f6473763-d060-4d0f-9c80-561ddcc32cec tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:33.808087 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-f6473763-d060-4d0f-9c80-561ddcc32cec tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 200 len: 1363 microversion: 2.1 time: 0.172489 Feb 04 18:12:33.809325 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 565/1137] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:33 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:34.338330 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-86b6fe20-b58a-412c-93c5-3ccd69ca71e6 req-21cd0ce9-fbb5-4c50-92d7-73f55705587c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe11be94-d623-43fe-9319-e6ea69528e71", "tag": "dcde5d5f-cc5d-4e44-a5cf-d8366abf9c4a"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:12:34.340366 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:12:34.340366 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:12:34.348536 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-86b6fe20-b58a-412c-93c5-3ccd69ca71e6 req-21cd0ce9-fbb5-4c50-92d7-73f55705587c service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:34.348982 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-86b6fe20-b58a-412c-93c5-3ccd69ca71e6 req-21cd0ce9-fbb5-4c50-92d7-73f55705587c service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:34.361296 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-86b6fe20-b58a-412c-93c5-3ccd69ca71e6 req-21cd0ce9-fbb5-4c50-92d7-73f55705587c service nova] Creating event network-changed:dcde5d5f-cc5d-4e44-a5cf-d8366abf9c4a for instance fe11be94-d623-43fe-9319-e6ea69528e71 on hv-cinder-82276 Feb 04 18:12:34.366877 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-86b6fe20-b58a-412c-93c5-3ccd69ca71e6 req-21cd0ce9-fbb5-4c50-92d7-73f55705587c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034537 Feb 04 18:12:34.367489 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 573/1138] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:12:34.643856 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-48e58502-d67b-4f27-ba6a-3dacb61bf736 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:34.644402 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-48e58502-d67b-4f27-ba6a-3dacb61bf736 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:34.650838 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-48e58502-d67b-4f27-ba6a-3dacb61bf736 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:34.651539 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-48e58502-d67b-4f27-ba6a-3dacb61bf736 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:34.652849 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-48e58502-d67b-4f27-ba6a-3dacb61bf736 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:34.653311 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-48e58502-d67b-4f27-ba6a-3dacb61bf736 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:34.794958 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-48e58502-d67b-4f27-ba6a-3dacb61bf736 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:34.802854 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-48e58502-d67b-4f27-ba6a-3dacb61bf736 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1266 microversion: 2.1 time: 0.162781 Feb 04 18:12:34.803452 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 566/1139] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:34 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:34.827606 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-af399b8d-49ed-4eb5-8755-66e356faa846 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:34.828995 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-af399b8d-49ed-4eb5-8755-66e356faa846 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:34.835873 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-af399b8d-49ed-4eb5-8755-66e356faa846 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:34.836547 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-af399b8d-49ed-4eb5-8755-66e356faa846 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:34.837534 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-af399b8d-49ed-4eb5-8755-66e356faa846 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:34.837978 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-af399b8d-49ed-4eb5-8755-66e356faa846 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:34.975258 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-af399b8d-49ed-4eb5-8755-66e356faa846 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:34.983176 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-af399b8d-49ed-4eb5-8755-66e356faa846 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 200 len: 1363 microversion: 2.1 time: 0.161387 Feb 04 18:12:34.983747 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 574/1140] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:34 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:35.834015 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-d6503078-7f43-4521-b474-73d06193d340 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:35.834668 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-d6503078-7f43-4521-b474-73d06193d340 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:35.841987 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d6503078-7f43-4521-b474-73d06193d340 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:35.842457 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d6503078-7f43-4521-b474-73d06193d340 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:35.843295 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d6503078-7f43-4521-b474-73d06193d340 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:35.843732 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d6503078-7f43-4521-b474-73d06193d340 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:35.982282 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-d6503078-7f43-4521-b474-73d06193d340 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:35.990205 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-d6503078-7f43-4521-b474-73d06193d340 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1266 microversion: 2.1 time: 0.159881 Feb 04 18:12:35.990826 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 567/1141] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:35 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:36.000779 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-4137a63b-7055-48e5-a4e6-b61998b7607a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:36.001618 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-4137a63b-7055-48e5-a4e6-b61998b7607a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:36.007771 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4137a63b-7055-48e5-a4e6-b61998b7607a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:36.008222 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4137a63b-7055-48e5-a4e6-b61998b7607a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:36.009006 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4137a63b-7055-48e5-a4e6-b61998b7607a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:36.009438 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-4137a63b-7055-48e5-a4e6-b61998b7607a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:36.152312 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-4137a63b-7055-48e5-a4e6-b61998b7607a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:36.159958 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-4137a63b-7055-48e5-a4e6-b61998b7607a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 200 len: 1363 microversion: 2.1 time: 0.162810 Feb 04 18:12:36.160557 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 575/1142] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:35 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:12:37.008284 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e8a8f84b-5a78-45f6-a39b-8ddb588bf319 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:37.008904 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-e8a8f84b-5a78-45f6-a39b-8ddb588bf319 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:37.015997 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e8a8f84b-5a78-45f6-a39b-8ddb588bf319 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:37.016485 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e8a8f84b-5a78-45f6-a39b-8ddb588bf319 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:37.017282 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e8a8f84b-5a78-45f6-a39b-8ddb588bf319 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:37.017722 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e8a8f84b-5a78-45f6-a39b-8ddb588bf319 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:37.156851 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e8a8f84b-5a78-45f6-a39b-8ddb588bf319 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:37.164383 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e8a8f84b-5a78-45f6-a39b-8ddb588bf319 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1266 microversion: 2.1 time: 0.159833 Feb 04 18:12:37.164963 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 568/1143] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:37 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:37.176557 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-82a58131-d0a3-4b87-888f-90d0a51644e7 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:37.177184 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-82a58131-d0a3-4b87-888f-90d0a51644e7 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:37.184080 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-82a58131-d0a3-4b87-888f-90d0a51644e7 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:37.184536 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-82a58131-d0a3-4b87-888f-90d0a51644e7 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:37.185344 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-82a58131-d0a3-4b87-888f-90d0a51644e7 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:37.185795 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-82a58131-d0a3-4b87-888f-90d0a51644e7 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:37.317755 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-82a58131-d0a3-4b87-888f-90d0a51644e7 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:37.325422 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-82a58131-d0a3-4b87-888f-90d0a51644e7 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 200 len: 1363 microversion: 2.1 time: 0.152646 Feb 04 18:12:37.325989 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 576/1144] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:37 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:38.181038 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-0c6aae1d-88a5-4a8a-b39a-bfd31e82b1b8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:38.181718 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-0c6aae1d-88a5-4a8a-b39a-bfd31e82b1b8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:38.187978 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0c6aae1d-88a5-4a8a-b39a-bfd31e82b1b8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:38.203648 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0c6aae1d-88a5-4a8a-b39a-bfd31e82b1b8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:38.203648 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0c6aae1d-88a5-4a8a-b39a-bfd31e82b1b8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:38.203648 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0c6aae1d-88a5-4a8a-b39a-bfd31e82b1b8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:38.324855 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-0c6aae1d-88a5-4a8a-b39a-bfd31e82b1b8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:38.332117 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-0c6aae1d-88a5-4a8a-b39a-bfd31e82b1b8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1266 microversion: 2.1 time: 0.154848 Feb 04 18:12:38.332690 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 569/1145] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:38 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:38.342724 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b1c7314c-6b3f-4ad1-a1e5-3e055c3c3634 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:38.343336 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-b1c7314c-6b3f-4ad1-a1e5-3e055c3c3634 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:38.349670 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b1c7314c-6b3f-4ad1-a1e5-3e055c3c3634 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:38.350118 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b1c7314c-6b3f-4ad1-a1e5-3e055c3c3634 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:38.350931 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b1c7314c-6b3f-4ad1-a1e5-3e055c3c3634 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:38.351367 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b1c7314c-6b3f-4ad1-a1e5-3e055c3c3634 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:38.487093 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-b1c7314c-6b3f-4ad1-a1e5-3e055c3c3634 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:38.494348 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-b1c7314c-6b3f-4ad1-a1e5-3e055c3c3634 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 200 len: 1363 microversion: 2.1 time: 0.155783 Feb 04 18:12:38.494950 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 577/1146] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:38 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:38.796497 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-11cd9c74-01cc-4607-ba1b-514462e22511 req-d3667acd-e68b-44e1-88a3-021973c5d214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdbc5838-213f-4ce8-8628-2c180bc6b92c", "name": "network-vif-plugged", "status": "completed", "tag": "1185b4cf-af56-43d5-94d4-dd578ae69eac"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:12:38.798046 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:12:38.798046 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:12:38.804828 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-11cd9c74-01cc-4607-ba1b-514462e22511 req-d3667acd-e68b-44e1-88a3-021973c5d214 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:38.810556 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-11cd9c74-01cc-4607-ba1b-514462e22511 req-d3667acd-e68b-44e1-88a3-021973c5d214 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:38.816222 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-11cd9c74-01cc-4607-ba1b-514462e22511 req-d3667acd-e68b-44e1-88a3-021973c5d214 service nova] Creating event network-vif-plugged:1185b4cf-af56-43d5-94d4-dd578ae69eac for instance fdbc5838-213f-4ce8-8628-2c180bc6b92c on hv-cinder-82276 Feb 04 18:12:38.821310 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-11cd9c74-01cc-4607-ba1b-514462e22511 req-d3667acd-e68b-44e1-88a3-021973c5d214 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028605 Feb 04 18:12:38.821906 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 570/1147] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:12:39.348818 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b7bdbe78-aa0b-4c22-af01-c6cfeeeba1a8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:39.349436 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-b7bdbe78-aa0b-4c22-af01-c6cfeeeba1a8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:39.356783 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b7bdbe78-aa0b-4c22-af01-c6cfeeeba1a8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:39.357236 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b7bdbe78-aa0b-4c22-af01-c6cfeeeba1a8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:39.358016 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b7bdbe78-aa0b-4c22-af01-c6cfeeeba1a8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:39.358484 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b7bdbe78-aa0b-4c22-af01-c6cfeeeba1a8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:39.497529 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-b7bdbe78-aa0b-4c22-af01-c6cfeeeba1a8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:39.504890 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-b7bdbe78-aa0b-4c22-af01-c6cfeeeba1a8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1266 microversion: 2.1 time: 0.159690 Feb 04 18:12:39.505470 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 578/1148] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:39 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:39.512677 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-bf479c42-5973-4c82-94a8-baf187013249 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:39.513380 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-bf479c42-5973-4c82-94a8-baf187013249 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:39.519620 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bf479c42-5973-4c82-94a8-baf187013249 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:39.520137 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bf479c42-5973-4c82-94a8-baf187013249 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:39.520922 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bf479c42-5973-4c82-94a8-baf187013249 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:39.521366 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-bf479c42-5973-4c82-94a8-baf187013249 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:39.662858 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-bf479c42-5973-4c82-94a8-baf187013249 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:39.670912 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-bf479c42-5973-4c82-94a8-baf187013249 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 200 len: 1363 microversion: 2.1 time: 0.163181 Feb 04 18:12:39.671496 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 571/1149] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:39 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:12:40.521933 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-2a083f8f-fbe6-4361-9760-31d5952f3a1f tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:40.522563 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-2a083f8f-fbe6-4361-9760-31d5952f3a1f tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:40.529393 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2a083f8f-fbe6-4361-9760-31d5952f3a1f tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:40.529841 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2a083f8f-fbe6-4361-9760-31d5952f3a1f tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:40.530697 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2a083f8f-fbe6-4361-9760-31d5952f3a1f tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:40.531128 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2a083f8f-fbe6-4361-9760-31d5952f3a1f tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:40.666766 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2a083f8f-fbe6-4361-9760-31d5952f3a1f tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:40.675031 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-2a083f8f-fbe6-4361-9760-31d5952f3a1f tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1266 microversion: 2.1 time: 0.156795 Feb 04 18:12:40.675609 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 579/1150] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:40 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:40.688015 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-7c18668f-2399-4b98-9ba3-3016e2031f99 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:40.688626 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-7c18668f-2399-4b98-9ba3-3016e2031f99 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:40.694856 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7c18668f-2399-4b98-9ba3-3016e2031f99 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:40.695302 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7c18668f-2399-4b98-9ba3-3016e2031f99 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:40.696072 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7c18668f-2399-4b98-9ba3-3016e2031f99 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:40.696505 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7c18668f-2399-4b98-9ba3-3016e2031f99 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:40.840049 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-7c18668f-2399-4b98-9ba3-3016e2031f99 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:40.847751 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-7c18668f-2399-4b98-9ba3-3016e2031f99 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 200 len: 1363 microversion: 2.1 time: 0.163421 Feb 04 18:12:40.848321 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 572/1151] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:40 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:41.692485 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-2cbfcbad-ee43-491a-a9cd-e5fdf5fd2f86 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:41.693141 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-2cbfcbad-ee43-491a-a9cd-e5fdf5fd2f86 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:41.700058 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2cbfcbad-ee43-491a-a9cd-e5fdf5fd2f86 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:41.700499 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2cbfcbad-ee43-491a-a9cd-e5fdf5fd2f86 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:41.701269 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2cbfcbad-ee43-491a-a9cd-e5fdf5fd2f86 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:41.701722 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2cbfcbad-ee43-491a-a9cd-e5fdf5fd2f86 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:41.836444 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2cbfcbad-ee43-491a-a9cd-e5fdf5fd2f86 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:41.843813 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-2cbfcbad-ee43-491a-a9cd-e5fdf5fd2f86 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1266 microversion: 2.1 time: 0.155072 Feb 04 18:12:41.844396 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 580/1152] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:41 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:41.864686 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-798c84f9-f756-44b9-a8c7-0dd03484f886 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:41.865285 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-798c84f9-f756-44b9-a8c7-0dd03484f886 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:41.872293 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-798c84f9-f756-44b9-a8c7-0dd03484f886 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:41.872746 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-798c84f9-f756-44b9-a8c7-0dd03484f886 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:41.873531 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-798c84f9-f756-44b9-a8c7-0dd03484f886 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:41.873977 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-798c84f9-f756-44b9-a8c7-0dd03484f886 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:42.006941 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-798c84f9-f756-44b9-a8c7-0dd03484f886 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:42.014316 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-798c84f9-f756-44b9-a8c7-0dd03484f886 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 200 len: 1549 microversion: 2.1 time: 0.153531 Feb 04 18:12:42.014927 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 573/1153] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:41 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:12:42.031312 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ba0b96e7-6282-4cfa-aa9c-57113ccb4313 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:42.031812 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ba0b96e7-6282-4cfa-aa9c-57113ccb4313 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:42.037770 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ba0b96e7-6282-4cfa-aa9c-57113ccb4313 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:42.038230 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ba0b96e7-6282-4cfa-aa9c-57113ccb4313 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:42.039039 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ba0b96e7-6282-4cfa-aa9c-57113ccb4313 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:42.039484 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ba0b96e7-6282-4cfa-aa9c-57113ccb4313 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:42.126009 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ba0b96e7-6282-4cfa-aa9c-57113ccb4313 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099268 Feb 04 18:12:42.126758 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 581/1154] 10.222.0.98 () {58 vars in 1274 bytes} [Fri Feb 4 18:12:42 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:12:42.861255 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-20d27c95-4955-40a7-bbea-c43a4b850450 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:42.862144 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-20d27c95-4955-40a7-bbea-c43a4b850450 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:42.868267 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-20d27c95-4955-40a7-bbea-c43a4b850450 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:42.868881 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-20d27c95-4955-40a7-bbea-c43a4b850450 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:42.869500 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-20d27c95-4955-40a7-bbea-c43a4b850450 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:42.869944 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-20d27c95-4955-40a7-bbea-c43a4b850450 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:43.149597 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-20d27c95-4955-40a7-bbea-c43a4b850450 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:43.157184 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-20d27c95-4955-40a7-bbea-c43a4b850450 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1266 microversion: 2.1 time: 0.299683 Feb 04 18:12:43.157761 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 574/1155] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:42 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1266 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:43.453624 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ad9762ac-5a08-4d32-a831-939464a64c1b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:43.454253 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ad9762ac-5a08-4d32-a831-939464a64c1b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:43.461094 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ad9762ac-5a08-4d32-a831-939464a64c1b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:43.461705 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ad9762ac-5a08-4d32-a831-939464a64c1b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:43.461927 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-7442aefa-6c88-40ed-ad26-a35d72786d02 req-0e69e9d9-0cfe-4186-9448-3c9069202dae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdbc5838-213f-4ce8-8628-2c180bc6b92c", "tag": "1185b4cf-af56-43d5-94d4-dd578ae69eac"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:12:43.462781 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ad9762ac-5a08-4d32-a831-939464a64c1b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:43.463354 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ad9762ac-5a08-4d32-a831-939464a64c1b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:43.463563 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:12:43.463563 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:12:43.471599 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-7442aefa-6c88-40ed-ad26-a35d72786d02 req-0e69e9d9-0cfe-4186-9448-3c9069202dae service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:43.472197 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-7442aefa-6c88-40ed-ad26-a35d72786d02 req-0e69e9d9-0cfe-4186-9448-3c9069202dae service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:43.485874 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-7442aefa-6c88-40ed-ad26-a35d72786d02 req-0e69e9d9-0cfe-4186-9448-3c9069202dae service nova] Creating event network-changed:1185b4cf-af56-43d5-94d4-dd578ae69eac for instance fdbc5838-213f-4ce8-8628-2c180bc6b92c on hv-cinder-82276 Feb 04 18:12:43.491875 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-7442aefa-6c88-40ed-ad26-a35d72786d02 req-0e69e9d9-0cfe-4186-9448-3c9069202dae service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033504 Feb 04 18:12:43.492818 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 575/1156] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:12:43.625922 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-ad9762ac-5a08-4d32-a831-939464a64c1b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:43.635317 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ad9762ac-5a08-4d32-a831-939464a64c1b tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 200 len: 1549 microversion: 2.1 time: 0.185908 Feb 04 18:12:43.637557 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 582/1157] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:43 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 1549 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:44.173691 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-70486d94-ac10-45e3-bcb6-b543d4bfe980 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:44.174397 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-70486d94-ac10-45e3-bcb6-b543d4bfe980 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:44.181879 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-70486d94-ac10-45e3-bcb6-b543d4bfe980 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:44.182335 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-70486d94-ac10-45e3-bcb6-b543d4bfe980 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:44.183700 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-70486d94-ac10-45e3-bcb6-b543d4bfe980 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:44.184141 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-70486d94-ac10-45e3-bcb6-b543d4bfe980 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:44.340710 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-70486d94-ac10-45e3-bcb6-b543d4bfe980 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:44.348695 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-70486d94-ac10-45e3-bcb6-b543d4bfe980 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1266 microversion: 2.1 time: 0.179074 Feb 04 18:12:44.349276 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 576/1158] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:44 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:12:44.652708 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-9bf22d60-acd6-447f-a143-fcbd32e3a2c5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:44.653434 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-9bf22d60-acd6-447f-a143-fcbd32e3a2c5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:44.659585 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9bf22d60-acd6-447f-a143-fcbd32e3a2c5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:44.660031 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9bf22d60-acd6-447f-a143-fcbd32e3a2c5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:44.660801 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9bf22d60-acd6-447f-a143-fcbd32e3a2c5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:44.661227 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9bf22d60-acd6-447f-a143-fcbd32e3a2c5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:44.805176 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-9bf22d60-acd6-447f-a143-fcbd32e3a2c5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:44.807831 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-9bf22d60-acd6-447f-a143-fcbd32e3a2c5 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 200 len: 1668 microversion: 2.1 time: 0.158831 Feb 04 18:12:44.809270 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 583/1159] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:44 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:44.824482 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-2f036587-0a62-459c-a014-41eb4648b30a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:44.825015 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-2f036587-0a62-459c-a014-41eb4648b30a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:44.831755 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2f036587-0a62-459c-a014-41eb4648b30a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:44.832207 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2f036587-0a62-459c-a014-41eb4648b30a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:44.832987 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2f036587-0a62-459c-a014-41eb4648b30a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:44.833434 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2f036587-0a62-459c-a014-41eb4648b30a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:44.856555 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-2f036587-0a62-459c-a014-41eb4648b30a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c/ips" status: 200 len: 146 microversion: 2.1 time: 0.035697 Feb 04 18:12:44.857142 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 577/1160] 10.222.0.98 () {58 vars in 1247 bytes} [Fri Feb 4 18:12:44 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:12:45.365808 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-31724abf-a560-4bb2-9dc7-df061176aea5 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:45.366341 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-31724abf-a560-4bb2-9dc7-df061176aea5 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:45.372768 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-31724abf-a560-4bb2-9dc7-df061176aea5 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:45.373208 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-31724abf-a560-4bb2-9dc7-df061176aea5 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:45.373972 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-31724abf-a560-4bb2-9dc7-df061176aea5 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:45.374447 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-31724abf-a560-4bb2-9dc7-df061176aea5 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:45.515558 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-31724abf-a560-4bb2-9dc7-df061176aea5 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:45.523388 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-31724abf-a560-4bb2-9dc7-df061176aea5 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1266 microversion: 2.1 time: 0.161531 Feb 04 18:12:45.523972 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 584/1161] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:45 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:46.416742 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-70eaaa30-f309-4d9b-b7ea-90bb8f5c4b7e req-92df0b0e-462b-42f8-8046-2e2f9bd8cec8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe11be94-d623-43fe-9319-e6ea69528e71", "name": "network-vif-plugged", "status": "completed", "tag": "dcde5d5f-cc5d-4e44-a5cf-d8366abf9c4a"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:12:46.418367 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:12:46.418367 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:12:46.426946 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-70eaaa30-f309-4d9b-b7ea-90bb8f5c4b7e req-92df0b0e-462b-42f8-8046-2e2f9bd8cec8 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:46.427397 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-70eaaa30-f309-4d9b-b7ea-90bb8f5c4b7e req-92df0b0e-462b-42f8-8046-2e2f9bd8cec8 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:46.438848 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-70eaaa30-f309-4d9b-b7ea-90bb8f5c4b7e req-92df0b0e-462b-42f8-8046-2e2f9bd8cec8 service nova] Creating event network-vif-plugged:dcde5d5f-cc5d-4e44-a5cf-d8366abf9c4a for instance fe11be94-d623-43fe-9319-e6ea69528e71 on hv-cinder-82276 Feb 04 18:12:46.443964 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-70eaaa30-f309-4d9b-b7ea-90bb8f5c4b7e req-92df0b0e-462b-42f8-8046-2e2f9bd8cec8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030692 Feb 04 18:12:46.444644 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 578/1162] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:12:46.539254 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-c72df2e7-67ac-41fb-9135-d5d4ead3a881 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:46.540062 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-c72df2e7-67ac-41fb-9135-d5d4ead3a881 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:46.546398 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c72df2e7-67ac-41fb-9135-d5d4ead3a881 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:46.546898 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c72df2e7-67ac-41fb-9135-d5d4ead3a881 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:46.547767 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c72df2e7-67ac-41fb-9135-d5d4ead3a881 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:46.548322 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c72df2e7-67ac-41fb-9135-d5d4ead3a881 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:46.685365 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c72df2e7-67ac-41fb-9135-d5d4ead3a881 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:46.693167 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-c72df2e7-67ac-41fb-9135-d5d4ead3a881 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1266 microversion: 2.1 time: 0.157697 Feb 04 18:12:46.693756 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 585/1163] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:46 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:47.668276 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-7433fa80-5d32-42d1-85af-5a813173351a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "626170c1-8360-43a6-a73b-3e2a52538f9b"}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:12:47.669960 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-7433fa80-5d32-42d1-85af-5a813173351a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:47.676448 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7433fa80-5d32-42d1-85af-5a813173351a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:47.676896 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7433fa80-5d32-42d1-85af-5a813173351a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:47.677677 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7433fa80-5d32-42d1-85af-5a813173351a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:47.678114 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7433fa80-5d32-42d1-85af-5a813173351a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:47.710845 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-1292a2fc-fb14-4077-bf75-a9e9514a966a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:47.711216 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-1292a2fc-fb14-4077-bf75-a9e9514a966a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:47.717689 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1292a2fc-fb14-4077-bf75-a9e9514a966a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:47.718139 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1292a2fc-fb14-4077-bf75-a9e9514a966a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:47.718952 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1292a2fc-fb14-4077-bf75-a9e9514a966a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:47.719384 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1292a2fc-fb14-4077-bf75-a9e9514a966a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:47.854984 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-1292a2fc-fb14-4077-bf75-a9e9514a966a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:47.863657 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-1292a2fc-fb14-4077-bf75-a9e9514a966a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1266 microversion: 2.1 time: 0.156881 Feb 04 18:12:47.864234 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 586/1164] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:47 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:12:48.563140 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-7433fa80-5d32-42d1-85af-5a813173351a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "POST /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.898774 Feb 04 18:12:48.563762 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 579/1165] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Feb 4 18:12:47 2022] POST /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c/os-volume_attachments => generated 194 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:12:48.880711 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-d5c661b7-582d-4748-a57e-e54143605fe7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:48.881319 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-d5c661b7-582d-4748-a57e-e54143605fe7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:48.888444 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d5c661b7-582d-4748-a57e-e54143605fe7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:48.888886 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d5c661b7-582d-4748-a57e-e54143605fe7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:48.889663 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d5c661b7-582d-4748-a57e-e54143605fe7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:48.890122 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d5c661b7-582d-4748-a57e-e54143605fe7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:49.029666 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-d5c661b7-582d-4748-a57e-e54143605fe7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:49.036948 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-d5c661b7-582d-4748-a57e-e54143605fe7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1453 microversion: 2.1 time: 0.159917 Feb 04 18:12:49.037522 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 587/1166] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:48 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:49.053637 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-eb88614e-1cbf-4967-8321-994d67b2193d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:49.054331 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-eb88614e-1cbf-4967-8321-994d67b2193d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:49.060609 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-eb88614e-1cbf-4967-8321-994d67b2193d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:49.061049 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-eb88614e-1cbf-4967-8321-994d67b2193d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:49.061880 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-eb88614e-1cbf-4967-8321-994d67b2193d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:49.062310 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-eb88614e-1cbf-4967-8321-994d67b2193d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:49.199555 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-eb88614e-1cbf-4967-8321-994d67b2193d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:12:49.207470 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-eb88614e-1cbf-4967-8321-994d67b2193d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1453 microversion: 2.1 time: 0.158484 Feb 04 18:12:49.208036 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 580/1167] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:12:49 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:12:51.333708 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-63d55833-4179-4627-b88d-4a4f808dbedd req-93fe2b4b-2489-48ec-8d74-497f6ce39853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe11be94-d623-43fe-9319-e6ea69528e71", "tag": "dcde5d5f-cc5d-4e44-a5cf-d8366abf9c4a"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:12:51.335235 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:12:51.335235 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:12:51.342943 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-63d55833-4179-4627-b88d-4a4f808dbedd req-93fe2b4b-2489-48ec-8d74-497f6ce39853 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:51.343394 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-63d55833-4179-4627-b88d-4a4f808dbedd req-93fe2b4b-2489-48ec-8d74-497f6ce39853 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:51.354593 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-63d55833-4179-4627-b88d-4a4f808dbedd req-93fe2b4b-2489-48ec-8d74-497f6ce39853 service nova] Creating event network-changed:dcde5d5f-cc5d-4e44-a5cf-d8366abf9c4a for instance fe11be94-d623-43fe-9319-e6ea69528e71 on hv-cinder-82276 Feb 04 18:12:51.360266 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-63d55833-4179-4627-b88d-4a4f808dbedd req-93fe2b4b-2489-48ec-8d74-497f6ce39853 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030059 Feb 04 18:12:51.360874 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 588/1168] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:12:57.087521 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e2fa4afb-28d6-423b-b2bd-7dbe102d6e4c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:57.088506 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-e2fa4afb-28d6-423b-b2bd-7dbe102d6e4c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:57.094895 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e2fa4afb-28d6-423b-b2bd-7dbe102d6e4c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:57.095344 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e2fa4afb-28d6-423b-b2bd-7dbe102d6e4c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:57.096121 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e2fa4afb-28d6-423b-b2bd-7dbe102d6e4c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:57.096557 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e2fa4afb-28d6-423b-b2bd-7dbe102d6e4c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:57.126559 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e2fa4afb-28d6-423b-b2bd-7dbe102d6e4c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042709 Feb 04 18:12:57.127113 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 581/1169] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:12:57 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:12:57.137664 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-c195d409-6831-4903-b8b5-3467a9c4136c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:12:57.139222 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-c195d409-6831-4903-b8b5-3467a9c4136c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:57.145999 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c195d409-6831-4903-b8b5-3467a9c4136c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:57.146456 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c195d409-6831-4903-b8b5-3467a9c4136c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:57.147251 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c195d409-6831-4903-b8b5-3467a9c4136c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:57.147737 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-c195d409-6831-4903-b8b5-3467a9c4136c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:57.176756 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-c195d409-6831-4903-b8b5-3467a9c4136c tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c/os-volume_attachments/626170c1-8360-43a6-a73b-3e2a52538f9b" status: 200 len: 194 microversion: 2.1 time: 0.043569 Feb 04 18:12:57.177350 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 589/1170] 10.222.0.98 () {58 vars in 1412 bytes} [Fri Feb 4 18:12:57 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c/os-volume_attachments/626170c1-8360-43a6-a73b-3e2a52538f9b => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:12:59.940835 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-992365d6-09d8-4c9d-813c-c07f7df47e34 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f728847-2c75-43b1-a947-78ceca2e48e8"}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:12:59.941895 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-992365d6-09d8-4c9d-813c-c07f7df47e34 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:12:59.948167 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-992365d6-09d8-4c9d-813c-c07f7df47e34 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:59.948621 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-992365d6-09d8-4c9d-813c-c07f7df47e34 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:12:59.949403 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-992365d6-09d8-4c9d-813c-c07f7df47e34 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:12:59.949846 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-992365d6-09d8-4c9d-813c-c07f7df47e34 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:13:00.928539 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-992365d6-09d8-4c9d-813c-c07f7df47e34 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "POST /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.991232 Feb 04 18:13:00.929164 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 582/1171] 10.222.0.98 () {60 vars in 1322 bytes} [Fri Feb 4 18:12:59 2022] POST /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c/os-volume_attachments => generated 194 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:13:06.500465 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-217cf524-3b36-46a0-a3bf-c9c58c490ac1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:06.501375 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-217cf524-3b36-46a0-a3bf-c9c58c490ac1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:13:06.507666 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-217cf524-3b36-46a0-a3bf-c9c58c490ac1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:13:06.508119 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-217cf524-3b36-46a0-a3bf-c9c58c490ac1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:13:06.508893 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-217cf524-3b36-46a0-a3bf-c9c58c490ac1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:13:06.509360 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-217cf524-3b36-46a0-a3bf-c9c58c490ac1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:13:06.538429 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-217cf524-3b36-46a0-a3bf-c9c58c490ac1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041946 Feb 04 18:13:06.538995 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 590/1172] 10.222.0.98 () {60 vars in 1342 bytes} [Fri Feb 4 18:13:06 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:13:06.594051 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a97e5c1f-14fa-48a5-98b4-d950b3d49822 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:06.594677 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-a97e5c1f-14fa-48a5-98b4-d950b3d49822 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:13:06.600647 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a97e5c1f-14fa-48a5-98b4-d950b3d49822 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:13:06.601096 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a97e5c1f-14fa-48a5-98b4-d950b3d49822 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:13:06.601868 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a97e5c1f-14fa-48a5-98b4-d950b3d49822 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:13:06.602302 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a97e5c1f-14fa-48a5-98b4-d950b3d49822 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:13:06.626787 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-a97e5c1f-14fa-48a5-98b4-d950b3d49822 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Going to try to terminate instance {{(pid=123567) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 04 18:13:06.924154 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a97e5c1f-14fa-48a5-98b4-d950b3d49822 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "DELETE /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 204 len: 0 microversion: 2.20 time: 0.334194 Feb 04 18:13:06.924745 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 583/1173] 10.222.0.98 () {60 vars in 1279 bytes} [Fri Feb 4 18:13:06 2022] DELETE /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 04 18:13:06.932605 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-7e787470-9e06-445f-baf5-e0311e6c5527 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:06.933247 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-7e787470-9e06-445f-baf5-e0311e6c5527 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:13:06.939927 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7e787470-9e06-445f-baf5-e0311e6c5527 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:13:06.940382 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7e787470-9e06-445f-baf5-e0311e6c5527 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:13:06.941190 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7e787470-9e06-445f-baf5-e0311e6c5527 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:13:06.941629 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7e787470-9e06-445f-baf5-e0311e6c5527 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:13:07.072445 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-7e787470-9e06-445f-baf5-e0311e6c5527 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:13:07.080362 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-7e787470-9e06-445f-baf5-e0311e6c5527 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:13:07.081867 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-7e787470-9e06-445f-baf5-e0311e6c5527 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:13:07.083063 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-7e787470-9e06-445f-baf5-e0311e6c5527 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1720 microversion: 2.20 time: 0.154097 Feb 04 18:13:07.083634 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 591/1174] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:13:06 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:13:08.101768 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b3a17708-2fcb-433a-ad48-0a9a3d9121ab tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:08.102451 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-b3a17708-2fcb-433a-ad48-0a9a3d9121ab tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:13:08.108852 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b3a17708-2fcb-433a-ad48-0a9a3d9121ab tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:13:08.109299 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b3a17708-2fcb-433a-ad48-0a9a3d9121ab tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:13:08.110106 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b3a17708-2fcb-433a-ad48-0a9a3d9121ab tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:13:08.110576 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b3a17708-2fcb-433a-ad48-0a9a3d9121ab tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:13:08.242795 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-b3a17708-2fcb-433a-ad48-0a9a3d9121ab tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:13:08.251301 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-b3a17708-2fcb-433a-ad48-0a9a3d9121ab tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:13:08.252820 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-b3a17708-2fcb-433a-ad48-0a9a3d9121ab tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:13:08.253998 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b3a17708-2fcb-433a-ad48-0a9a3d9121ab tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1720 microversion: 2.20 time: 0.156490 Feb 04 18:13:08.254586 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 584/1175] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:13:08 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:13:09.272849 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-feb6b4e1-dc68-4c5f-a9b0-7e37ce05b267 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:09.273565 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-feb6b4e1-dc68-4c5f-a9b0-7e37ce05b267 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:13:09.279805 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-feb6b4e1-dc68-4c5f-a9b0-7e37ce05b267 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:13:09.280250 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-feb6b4e1-dc68-4c5f-a9b0-7e37ce05b267 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:13:09.281034 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-feb6b4e1-dc68-4c5f-a9b0-7e37ce05b267 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:13:09.282104 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-feb6b4e1-dc68-4c5f-a9b0-7e37ce05b267 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:13:09.426928 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-feb6b4e1-dc68-4c5f-a9b0-7e37ce05b267 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:13:09.435329 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-feb6b4e1-dc68-4c5f-a9b0-7e37ce05b267 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:13:09.437006 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-feb6b4e1-dc68-4c5f-a9b0-7e37ce05b267 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:13:09.438170 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-feb6b4e1-dc68-4c5f-a9b0-7e37ce05b267 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1720 microversion: 2.20 time: 0.169271 Feb 04 18:13:09.438922 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 592/1176] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:13:09 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:13:09.446310 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-32f4e820-01f2-4372-a8ba-926d2ccca4a7 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:09.447316 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-32f4e820-01f2-4372-a8ba-926d2ccca4a7 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:13:09.454637 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-32f4e820-01f2-4372-a8ba-926d2ccca4a7 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:13:09.455088 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-32f4e820-01f2-4372-a8ba-926d2ccca4a7 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:13:09.455874 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-32f4e820-01f2-4372-a8ba-926d2ccca4a7 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:13:09.456313 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-32f4e820-01f2-4372-a8ba-926d2ccca4a7 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:13:09.487121 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-32f4e820-01f2-4372-a8ba-926d2ccca4a7 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044660 Feb 04 18:13:09.487785 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 585/1177] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:13:09 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:13:10.214486 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-f9c8ea22-8285-43f7-bcd3-5dbac515a287 req-fd108399-1e25-4559-ba52-720bb2856c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32416d02-187d-4d8f-9698-d36ac5ffbc26", "name": "network-vif-deleted", "tag": "8dbc5ea2-225d-4915-8e59-f39e014f906a"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:13:10.216200 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:13:10.216200 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:13:10.223025 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-f9c8ea22-8285-43f7-bcd3-5dbac515a287 req-fd108399-1e25-4559-ba52-720bb2856c8c service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:13:10.223453 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-f9c8ea22-8285-43f7-bcd3-5dbac515a287 req-fd108399-1e25-4559-ba52-720bb2856c8c service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:13:10.234773 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-f9c8ea22-8285-43f7-bcd3-5dbac515a287 req-fd108399-1e25-4559-ba52-720bb2856c8c service nova] Creating event network-vif-deleted:8dbc5ea2-225d-4915-8e59-f39e014f906a for instance 32416d02-187d-4d8f-9698-d36ac5ffbc26 on hv-cinder-82276 Feb 04 18:13:10.240094 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-f9c8ea22-8285-43f7-bcd3-5dbac515a287 req-fd108399-1e25-4559-ba52-720bb2856c8c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031377 Feb 04 18:13:10.240848 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 593/1178] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:13:10.458851 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-5d4a8c6d-bf3a-4d3b-9f6a-d52301eac5a1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:10.459646 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-5d4a8c6d-bf3a-4d3b-9f6a-d52301eac5a1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:13:10.465976 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5d4a8c6d-bf3a-4d3b-9f6a-d52301eac5a1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:13:10.466549 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5d4a8c6d-bf3a-4d3b-9f6a-d52301eac5a1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:13:10.467246 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5d4a8c6d-bf3a-4d3b-9f6a-d52301eac5a1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:13:10.467686 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5d4a8c6d-bf3a-4d3b-9f6a-d52301eac5a1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:13:10.536080 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5d4a8c6d-bf3a-4d3b-9f6a-d52301eac5a1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:13:10.542505 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5d4a8c6d-bf3a-4d3b-9f6a-d52301eac5a1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:13:10.544272 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5d4a8c6d-bf3a-4d3b-9f6a-d52301eac5a1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74e23ced236b429c8aab135f45fe3e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745beddd0c154d82a7e95298706587b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:13:10.545470 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-5d4a8c6d-bf3a-4d3b-9f6a-d52301eac5a1 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 200 len: 1366 microversion: 2.20 time: 0.090489 Feb 04 18:13:10.546035 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 586/1179] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:13:10 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 1366 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 04 18:13:11.566305 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-5cb2cd89-35f0-453a-a333-5c0483931b8e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:11.567029 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-5cb2cd89-35f0-453a-a333-5c0483931b8e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:13:11.573271 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5cb2cd89-35f0-453a-a333-5c0483931b8e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:13:11.573742 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5cb2cd89-35f0-453a-a333-5c0483931b8e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:13:11.574531 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5cb2cd89-35f0-453a-a333-5c0483931b8e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:13:11.574962 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5cb2cd89-35f0-453a-a333-5c0483931b8e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:13:11.587898 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-5cb2cd89-35f0-453a-a333-5c0483931b8e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] HTTP exception thrown: Instance 32416d02-187d-4d8f-9698-d36ac5ffbc26 could not be found. Feb 04 18:13:11.588480 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-5cb2cd89-35f0-453a-a333-5c0483931b8e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Returning 404 to user: Instance 32416d02-187d-4d8f-9698-d36ac5ffbc26 could not be found. {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:13:11.589318 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-5cb2cd89-35f0-453a-a333-5c0483931b8e tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 404 len: 111 microversion: 2.20 time: 0.028179 Feb 04 18:13:11.589856 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 594/1180] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:13:11 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 04 18:13:11.598207 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-0144912e-8d13-45cc-ae77-7b8c96c49d40 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '.version_select at 0x7fe8cc969ee0>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:11.692004 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-0144912e-8d13-45cc-ae77-7b8c96c49d40 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-580612381" status: 204 len: 0 microversion: 2.20 time: 0.097547 Feb 04 18:13:11.692592 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 587/1181] 10.222.0.98 () {60 vars in 1258 bytes} [Fri Feb 4 18:13:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-580612381 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 04 18:13:13.906765 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-32e34914-0e36-4ce5-910c-72dfafcbad20 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:13.907827 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-32e34914-0e36-4ce5-910c-72dfafcbad20 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:13:13.914292 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-32e34914-0e36-4ce5-910c-72dfafcbad20 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:13:13.914774 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-32e34914-0e36-4ce5-910c-72dfafcbad20 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:13:13.915544 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-32e34914-0e36-4ce5-910c-72dfafcbad20 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:13:13.915980 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-32e34914-0e36-4ce5-910c-72dfafcbad20 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:13:13.929123 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-32e34914-0e36-4ce5-910c-72dfafcbad20 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] HTTP exception thrown: Instance 32416d02-187d-4d8f-9698-d36ac5ffbc26 could not be found. Feb 04 18:13:13.929704 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-32e34914-0e36-4ce5-910c-72dfafcbad20 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Returning 404 to user: Instance 32416d02-187d-4d8f-9698-d36ac5ffbc26 could not be found. {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:13:13.930542 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-32e34914-0e36-4ce5-910c-72dfafcbad20 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "DELETE /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 404 len: 111 microversion: 2.20 time: 0.027758 Feb 04 18:13:13.931062 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 595/1182] 10.222.0.98 () {60 vars in 1279 bytes} [Fri Feb 4 18:13:13 2022] DELETE /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 04 18:13:13.939457 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-f7bbe42e-ec90-4dc1-974e-1f7f9e3b4512 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:13.940090 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-f7bbe42e-ec90-4dc1-974e-1f7f9e3b4512 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 32416d02-187d-4d8f-9698-d36ac5ffbc26] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:13:13.951554 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f7bbe42e-ec90-4dc1-974e-1f7f9e3b4512 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:13:13.952012 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f7bbe42e-ec90-4dc1-974e-1f7f9e3b4512 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:13:13.952795 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f7bbe42e-ec90-4dc1-974e-1f7f9e3b4512 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:13:13.953244 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f7bbe42e-ec90-4dc1-974e-1f7f9e3b4512 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:13:13.967350 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.wsgi [None req-f7bbe42e-ec90-4dc1-974e-1f7f9e3b4512 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] HTTP exception thrown: Instance 32416d02-187d-4d8f-9698-d36ac5ffbc26 could not be found. Feb 04 18:13:13.967940 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-f7bbe42e-ec90-4dc1-974e-1f7f9e3b4512 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Returning 404 to user: Instance 32416d02-187d-4d8f-9698-d36ac5ffbc26 could not be found. {{(pid=123567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:13:13.968823 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-f7bbe42e-ec90-4dc1-974e-1f7f9e3b4512 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26" status: 404 len: 111 microversion: 2.20 time: 0.033740 Feb 04 18:13:13.970023 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 588/1183] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:13:13 2022] GET /compute/v2.1/servers/32416d02-187d-4d8f-9698-d36ac5ffbc26 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 04 18:13:15.326733 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-3b4e098a-6d2c-4461-ac3b-71a3148babd5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:15.327312 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-3b4e098a-6d2c-4461-ac3b-71a3148babd5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:13:15.333541 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3b4e098a-6d2c-4461-ac3b-71a3148babd5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:13:15.333995 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3b4e098a-6d2c-4461-ac3b-71a3148babd5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:13:15.334815 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3b4e098a-6d2c-4461-ac3b-71a3148babd5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:13:15.335258 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3b4e098a-6d2c-4461-ac3b-71a3148babd5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:13:15.348474 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-3b4e098a-6d2c-4461-ac3b-71a3148babd5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] HTTP exception thrown: Instance 514ca883-72d2-4695-a4b6-47c18ce4add5 could not be found. Feb 04 18:13:15.349051 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-3b4e098a-6d2c-4461-ac3b-71a3148babd5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Returning 404 to user: Instance 514ca883-72d2-4695-a4b6-47c18ce4add5 could not be found. {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:13:15.349907 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-3b4e098a-6d2c-4461-ac3b-71a3148babd5 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "DELETE /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 404 len: 111 microversion: 2.20 time: 0.026929 Feb 04 18:13:15.350449 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 596/1184] 10.222.0.98 () {60 vars in 1279 bytes} [Fri Feb 4 18:13:15 2022] DELETE /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 04 18:13:15.358140 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-253fe05d-68a8-48b9-87bd-18a04313eed0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:15.358790 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-253fe05d-68a8-48b9-87bd-18a04313eed0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] [instance: 514ca883-72d2-4695-a4b6-47c18ce4add5] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:13:15.365863 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-253fe05d-68a8-48b9-87bd-18a04313eed0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:13:15.366314 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-253fe05d-68a8-48b9-87bd-18a04313eed0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:13:15.367136 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-253fe05d-68a8-48b9-87bd-18a04313eed0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:13:15.367583 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-253fe05d-68a8-48b9-87bd-18a04313eed0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:13:15.381077 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.wsgi [None req-253fe05d-68a8-48b9-87bd-18a04313eed0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] HTTP exception thrown: Instance 514ca883-72d2-4695-a4b6-47c18ce4add5 could not be found. Feb 04 18:13:15.381662 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-253fe05d-68a8-48b9-87bd-18a04313eed0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] Returning 404 to user: Instance 514ca883-72d2-4695-a4b6-47c18ce4add5 could not be found. {{(pid=123567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:13:15.382504 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-253fe05d-68a8-48b9-87bd-18a04313eed0 tempest-AttachVolumeShelveTestJSON-1865877584 tempest-AttachVolumeShelveTestJSON-1865877584-project] 10.222.0.98 "GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5" status: 404 len: 111 microversion: 2.20 time: 0.028063 Feb 04 18:13:15.383034 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 589/1185] 10.222.0.98 () {60 vars in 1276 bytes} [Fri Feb 4 18:13:15 2022] GET /compute/v2.1/servers/514ca883-72d2-4695-a4b6-47c18ce4add5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 04 18:13:21.403765 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-49da6303-f399-44c1-b8f1-2ecfd934edc8 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] Action: 'create', calling method: .version_select at 0x7fe8cc105dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1364396103"}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:13:22.168899 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-49da6303-f399-44c1-b8f1-2ecfd934edc8 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] 10.222.0.98 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.889400 Feb 04 18:13:22.169517 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 597/1186] 10.222.0.98 () {60 vars in 1154 bytes} [Fri Feb 4 18:13:21 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 891 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 04 18:13:22.180341 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-5373f07b-9f9f-4c38-ba57-9148d9d14691 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] Calling method '.version_select at 0x7fe8cc9d0c10>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:22.227512 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-5373f07b-9f9f-4c38-ba57-9148d9d14691 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/b1acf3b5-cfbe-46c6-a65b-e8fe74c529e8" status: 200 len: 345 microversion: 2.1 time: 0.050681 Feb 04 18:13:22.228093 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 590/1187] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Feb 4 18:13:22 2022] GET /compute/v2.1/os-volumes/b1acf3b5-cfbe-46c6-a65b-e8fe74c529e8 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:13:23.241142 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-78e8f171-6dd5-475b-bb79-f0b5e9f7d841 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] Calling method '.version_select at 0x7fe8cc0a5ca0>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:23.285537 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-78e8f171-6dd5-475b-bb79-f0b5e9f7d841 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/b1acf3b5-cfbe-46c6-a65b-e8fe74c529e8" status: 200 len: 345 microversion: 2.1 time: 0.049333 Feb 04 18:13:23.286099 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 598/1188] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Feb 4 18:13:23 2022] GET /compute/v2.1/os-volumes/b1acf3b5-cfbe-46c6-a65b-e8fe74c529e8 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:13:24.298180 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-ac007b4c-0924-48fa-b18a-12caf04347c2 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] Calling method '.version_select at 0x7fe8cca31790>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:24.343015 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-ac007b4c-0924-48fa-b18a-12caf04347c2 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/b1acf3b5-cfbe-46c6-a65b-e8fe74c529e8" status: 200 len: 346 microversion: 2.1 time: 0.048933 Feb 04 18:13:24.343592 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 591/1189] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Feb 4 18:13:24 2022] GET /compute/v2.1/os-volumes/b1acf3b5-cfbe-46c6-a65b-e8fe74c529e8 => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:13:24.355437 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-7ef02093-84c4-4993-97dd-069853cc90fe tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] Action: 'create', calling method: .version_select at 0x7fe8bfffc3a0>, body: {"snapshot": {"volume_id": "b1acf3b5-cfbe-46c6-a65b-e8fe74c529e8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-458030646"}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:13:24.815382 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-7ef02093-84c4-4993-97dd-069853cc90fe tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] 10.222.0.98 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.463972 Feb 04 18:13:24.816294 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 599/1190] 10.222.0.98 () {60 vars in 1161 bytes} [Fri Feb 4 18:13:24 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:13:24.825760 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-6c8fa5da-d880-45b3-9bcc-d01436429b89 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] Calling method '.version_select at 0x7fe8d0bf3dc0>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:24.854166 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-6c8fa5da-d880-45b3-9bcc-d01436429b89 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/5f02a9d0-5a4d-4a9a-96d7-276f0281a712" status: 200 len: 286 microversion: 2.1 time: 0.032171 Feb 04 18:13:24.854775 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 592/1191] 10.222.0.98 () {58 vars in 1250 bytes} [Fri Feb 4 18:13:24 2022] GET /compute/v2.1/os-snapshots/5f02a9d0-5a4d-4a9a-96d7-276f0281a712 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:13:24.868809 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-57a9644e-936a-4f54-9e73-17b133a7a61f tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] Calling method '.version_select at 0x7fe8cc105b80>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:24.898861 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-57a9644e-936a-4f54-9e73-17b133a7a61f tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.033596 Feb 04 18:13:24.899449 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 600/1192] 10.222.0.98 () {58 vars in 1139 bytes} [Fri Feb 4 18:13:24 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:13:24.909890 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-aeca1309-0bda-48fa-8676-6b51fe928302 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] Calling method '.version_select at 0x7fe8cc9ac5e0>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:24.937852 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-aeca1309-0bda-48fa-8676-6b51fe928302 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/5f02a9d0-5a4d-4a9a-96d7-276f0281a712" status: 200 len: 286 microversion: 2.1 time: 0.032120 Feb 04 18:13:24.938467 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 593/1193] 10.222.0.98 () {58 vars in 1250 bytes} [Fri Feb 4 18:13:24 2022] GET /compute/v2.1/os-snapshots/5f02a9d0-5a4d-4a9a-96d7-276f0281a712 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:13:25.949721 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-06fdb497-cbbd-4875-8bda-72db89dc8f74 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] Calling method '.version_select at 0x7fe8cc0e9670>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:25.978438 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-06fdb497-cbbd-4875-8bda-72db89dc8f74 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/5f02a9d0-5a4d-4a9a-96d7-276f0281a712" status: 200 len: 286 microversion: 2.1 time: 0.032713 Feb 04 18:13:25.979006 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 601/1194] 10.222.0.98 () {58 vars in 1250 bytes} [Fri Feb 4 18:13:25 2022] GET /compute/v2.1/os-snapshots/5f02a9d0-5a4d-4a9a-96d7-276f0281a712 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:13:26.990478 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-cd677370-fa2c-4f7f-99e8-c0927c36e33a tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] Calling method '.version_select at 0x7fe8cc9953a0>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:27.018738 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-cd677370-fa2c-4f7f-99e8-c0927c36e33a tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/5f02a9d0-5a4d-4a9a-96d7-276f0281a712" status: 200 len: 286 microversion: 2.1 time: 0.032464 Feb 04 18:13:27.019913 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 594/1195] 10.222.0.98 () {58 vars in 1250 bytes} [Fri Feb 4 18:13:26 2022] GET /compute/v2.1/os-snapshots/5f02a9d0-5a4d-4a9a-96d7-276f0281a712 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:13:28.032130 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-3fb56e23-8013-49b5-84d5-f7ca89e87d7d tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] Calling method '.version_select at 0x7fe8bffaa9d0>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:28.060116 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-3fb56e23-8013-49b5-84d5-f7ca89e87d7d tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/5f02a9d0-5a4d-4a9a-96d7-276f0281a712" status: 200 len: 286 microversion: 2.1 time: 0.032559 Feb 04 18:13:28.060673 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 602/1196] 10.222.0.98 () {58 vars in 1250 bytes} [Fri Feb 4 18:13:28 2022] GET /compute/v2.1/os-snapshots/5f02a9d0-5a4d-4a9a-96d7-276f0281a712 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:13:29.072445 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-d33fe5e6-8bea-4749-bd56-dc7aa0a1eab4 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] Calling method '.version_select at 0x7fe8cc9d01f0>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:29.100898 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-d33fe5e6-8bea-4749-bd56-dc7aa0a1eab4 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/5f02a9d0-5a4d-4a9a-96d7-276f0281a712" status: 200 len: 286 microversion: 2.1 time: 0.032516 Feb 04 18:13:29.101470 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 595/1197] 10.222.0.98 () {58 vars in 1250 bytes} [Fri Feb 4 18:13:29 2022] GET /compute/v2.1/os-snapshots/5f02a9d0-5a4d-4a9a-96d7-276f0281a712 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:13:30.113736 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-6f0bbadd-6e26-4b79-a29b-ae2f0f31d577 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] Calling method '.version_select at 0x7fe8cc07b430>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:30.141405 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-6f0bbadd-6e26-4b79-a29b-ae2f0f31d577 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/5f02a9d0-5a4d-4a9a-96d7-276f0281a712" status: 200 len: 287 microversion: 2.1 time: 0.032319 Feb 04 18:13:30.141981 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 603/1198] 10.222.0.98 () {58 vars in 1250 bytes} [Fri Feb 4 18:13:30 2022] GET /compute/v2.1/os-snapshots/5f02a9d0-5a4d-4a9a-96d7-276f0281a712 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:13:30.152633 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-5fb9e58b-2275-4b9d-98ad-cf88e3190ae9 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] Calling method '.version_select at 0x7fe8d0bf3820>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:30.320071 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-5fb9e58b-2275-4b9d-98ad-cf88e3190ae9 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] 10.222.0.98 "DELETE /compute/v2.1/os-snapshots/5f02a9d0-5a4d-4a9a-96d7-276f0281a712" status: 202 len: 0 microversion: 2.1 time: 0.168318 Feb 04 18:13:30.320071 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 596/1199] 10.222.0.98 () {58 vars in 1253 bytes} [Fri Feb 4 18:13:30 2022] DELETE /compute/v2.1/os-snapshots/5f02a9d0-5a4d-4a9a-96d7-276f0281a712 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 04 18:13:30.325705 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-bf587c9a-a7e5-4c53-9bfd-f9003aa73790 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] Calling method '.version_select at 0x7fe8cc082dc0>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:30.356640 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-bf587c9a-a7e5-4c53-9bfd-f9003aa73790 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/5f02a9d0-5a4d-4a9a-96d7-276f0281a712" status: 200 len: 286 microversion: 2.1 time: 0.034425 Feb 04 18:13:30.357271 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 604/1200] 10.222.0.98 () {58 vars in 1250 bytes} [Fri Feb 4 18:13:30 2022] GET /compute/v2.1/os-snapshots/5f02a9d0-5a4d-4a9a-96d7-276f0281a712 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:13:31.369280 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-6023f4eb-347e-453c-8aad-d81cc1baeea9 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] Calling method '.version_select at 0x7fe8cca13ca0>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:31.392181 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.wsgi [None req-6023f4eb-347e-453c-8aad-d81cc1baeea9 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] HTTP exception thrown: Snapshot 5f02a9d0-5a4d-4a9a-96d7-276f0281a712 could not be found. Feb 04 18:13:31.392778 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-6023f4eb-347e-453c-8aad-d81cc1baeea9 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] Returning 404 to user: Snapshot 5f02a9d0-5a4d-4a9a-96d7-276f0281a712 could not be found. {{(pid=123567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:13:31.393610 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-6023f4eb-347e-453c-8aad-d81cc1baeea9 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/5f02a9d0-5a4d-4a9a-96d7-276f0281a712" status: 404 len: 111 microversion: 2.1 time: 0.029133 Feb 04 18:13:31.394156 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 597/1201] 10.222.0.98 () {58 vars in 1250 bytes} [Fri Feb 4 18:13:31 2022] GET /compute/v2.1/os-snapshots/5f02a9d0-5a4d-4a9a-96d7-276f0281a712 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:13:31.403070 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ab7deb1c-06eb-4bdf-8848-15a068ecf505 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] Calling method '.version_select at 0x7fe8bffcee50>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:31.701011 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ab7deb1c-06eb-4bdf-8848-15a068ecf505 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/b1acf3b5-cfbe-46c6-a65b-e8fe74c529e8" status: 202 len: 0 microversion: 2.1 time: 0.302256 Feb 04 18:13:31.701654 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 605/1202] 10.222.0.98 () {58 vars in 1247 bytes} [Fri Feb 4 18:13:31 2022] DELETE /compute/v2.1/os-volumes/b1acf3b5-cfbe-46c6-a65b-e8fe74c529e8 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 04 18:13:31.710564 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-24821dcc-28a6-46c7-ac29-1a244939be31 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] Calling method '.version_select at 0x7fe8cca13550>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:31.755523 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-24821dcc-28a6-46c7-ac29-1a244939be31 tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/b1acf3b5-cfbe-46c6-a65b-e8fe74c529e8" status: 200 len: 345 microversion: 2.1 time: 0.049395 Feb 04 18:13:31.756242 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 598/1203] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Feb 4 18:13:31 2022] GET /compute/v2.1/os-volumes/b1acf3b5-cfbe-46c6-a65b-e8fe74c529e8 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:13:32.768595 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-e6717f48-695e-420d-8942-d7a261987ecf tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] Calling method '.version_select at 0x7fe8bffaad30>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:32.794151 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-e6717f48-695e-420d-8942-d7a261987ecf tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] HTTP exception thrown: Volume b1acf3b5-cfbe-46c6-a65b-e8fe74c529e8 could not be found. Feb 04 18:13:32.794782 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-e6717f48-695e-420d-8942-d7a261987ecf tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] Returning 404 to user: Volume b1acf3b5-cfbe-46c6-a65b-e8fe74c529e8 could not be found. {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:13:32.795587 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-e6717f48-695e-420d-8942-d7a261987ecf tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/b1acf3b5-cfbe-46c6-a65b-e8fe74c529e8" status: 404 len: 109 microversion: 2.1 time: 0.031206 Feb 04 18:13:32.796105 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 606/1204] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Feb 4 18:13:32 2022] GET /compute/v2.1/os-volumes/b1acf3b5-cfbe-46c6-a65b-e8fe74c529e8 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:13:32.806110 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-61805593-6bfb-4449-ad45-f2738988e28e tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] Calling method '.version_select at 0x7fe8cc9ac5e0>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:32.833910 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.wsgi [None req-61805593-6bfb-4449-ad45-f2738988e28e tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] HTTP exception thrown: Volume b1acf3b5-cfbe-46c6-a65b-e8fe74c529e8 could not be found. Feb 04 18:13:32.834623 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-61805593-6bfb-4449-ad45-f2738988e28e tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] Returning 404 to user: Volume b1acf3b5-cfbe-46c6-a65b-e8fe74c529e8 could not be found. {{(pid=123567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:13:32.835500 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-61805593-6bfb-4449-ad45-f2738988e28e tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/b1acf3b5-cfbe-46c6-a65b-e8fe74c529e8" status: 404 len: 109 microversion: 2.1 time: 0.034222 Feb 04 18:13:32.836044 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 599/1205] 10.222.0.98 () {58 vars in 1247 bytes} [Fri Feb 4 18:13:32 2022] DELETE /compute/v2.1/os-volumes/b1acf3b5-cfbe-46c6-a65b-e8fe74c529e8 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:13:32.844330 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-7386320c-6652-4754-a4be-2416c5e9a11a tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] Calling method '.version_select at 0x7fe8bffd58b0>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:32.870659 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-7386320c-6652-4754-a4be-2416c5e9a11a tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] HTTP exception thrown: Volume b1acf3b5-cfbe-46c6-a65b-e8fe74c529e8 could not be found. Feb 04 18:13:32.871252 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-7386320c-6652-4754-a4be-2416c5e9a11a tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] Returning 404 to user: Volume b1acf3b5-cfbe-46c6-a65b-e8fe74c529e8 could not be found. {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:13:32.872070 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-7386320c-6652-4754-a4be-2416c5e9a11a tempest-VolumesSnapshotsTestJSON-199431967 tempest-VolumesSnapshotsTestJSON-199431967-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/b1acf3b5-cfbe-46c6-a65b-e8fe74c529e8" status: 404 len: 109 microversion: 2.1 time: 0.031428 Feb 04 18:13:32.872596 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 607/1206] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Feb 4 18:13:32 2022] GET /compute/v2.1/os-volumes/b1acf3b5-cfbe-46c6-a65b-e8fe74c529e8 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:13:35.186326 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b1710cac-fa4e-412c-8e79-fe66aea4d7eb tempest-VolumesNegativeTest-1871903146 tempest-VolumesNegativeTest-1871903146-project] Action: 'create', calling method: .version_select at 0x7fe8cca13820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-349046544", "metadata": {"Type": "work"}}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:13:35.187882 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b1710cac-fa4e-412c-8e79-fe66aea4d7eb tempest-VolumesNegativeTest-1871903146 tempest-VolumesNegativeTest-1871903146-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:13:35.188705 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b1710cac-fa4e-412c-8e79-fe66aea4d7eb tempest-VolumesNegativeTest-1871903146 tempest-VolumesNegativeTest-1871903146-project] 10.222.0.98 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.113415 Feb 04 18:13:35.189260 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 600/1207] 10.222.0.98 () {60 vars in 1155 bytes} [Fri Feb 4 18:13:35 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 04 18:13:35.199025 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-54690c9d-731b-4653-966a-3916a704687d tempest-VolumesNegativeTest-1871903146 tempest-VolumesNegativeTest-1871903146-project] Action: 'create', calling method: .version_select at 0x7fe8cc0828b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2013956984", "metadata": {"Type": "work"}}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:13:35.202538 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-54690c9d-731b-4653-966a-3916a704687d tempest-VolumesNegativeTest-1871903146 tempest-VolumesNegativeTest-1871903146-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:13:35.203343 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-54690c9d-731b-4653-966a-3916a704687d tempest-VolumesNegativeTest-1871903146 tempest-VolumesNegativeTest-1871903146-project] 10.222.0.98 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008518 Feb 04 18:13:35.205817 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 608/1208] 10.222.0.98 () {60 vars in 1155 bytes} [Fri Feb 4 18:13:35 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 04 18:13:35.213091 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e326e8f0-436c-4ddd-8d22-5dc9d7695eab tempest-VolumesNegativeTest-1871903146 tempest-VolumesNegativeTest-1871903146-project] Action: 'create', calling method: .version_select at 0x7fe8d0c73160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-669568816", "metadata": {"Type": "work"}}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:13:35.214992 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e326e8f0-436c-4ddd-8d22-5dc9d7695eab tempest-VolumesNegativeTest-1871903146 tempest-VolumesNegativeTest-1871903146-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:13:35.215787 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e326e8f0-436c-4ddd-8d22-5dc9d7695eab tempest-VolumesNegativeTest-1871903146 tempest-VolumesNegativeTest-1871903146-project] 10.222.0.98 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007109 Feb 04 18:13:35.216307 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 601/1209] 10.222.0.98 () {60 vars in 1155 bytes} [Fri Feb 4 18:13:35 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 04 18:13:35.225557 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-7bcb9dbc-0e6a-4825-b24e-7c84fc06583f tempest-VolumesNegativeTest-1871903146 tempest-VolumesNegativeTest-1871903146-project] Calling method '.version_select at 0x7fe8cc0a5550>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:35.251295 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-7bcb9dbc-0e6a-4825-b24e-7c84fc06583f tempest-VolumesNegativeTest-1871903146 tempest-VolumesNegativeTest-1871903146-project] HTTP exception thrown: Volume tempest-invalid-778512880 could not be found. Feb 04 18:13:35.251888 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-7bcb9dbc-0e6a-4825-b24e-7c84fc06583f tempest-VolumesNegativeTest-1871903146 tempest-VolumesNegativeTest-1871903146-project] Returning 404 to user: Volume tempest-invalid-778512880 could not be found. {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:13:35.252711 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-7bcb9dbc-0e6a-4825-b24e-7c84fc06583f tempest-VolumesNegativeTest-1871903146 tempest-VolumesNegativeTest-1871903146-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/tempest-invalid-778512880" status: 404 len: 98 microversion: 2.1 time: 0.031536 Feb 04 18:13:35.253236 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 609/1210] 10.222.0.98 () {58 vars in 1214 bytes} [Fri Feb 4 18:13:35 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-778512880 => generated 98 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 04 18:13:35.262963 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-490fd836-343f-4423-8ed0-5a0f1d295722 tempest-VolumesNegativeTest-1871903146 tempest-VolumesNegativeTest-1871903146-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003627 Feb 04 18:13:35.263469 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 602/1211] 10.222.0.98 () {58 vars in 1139 bytes} [Fri Feb 4 18:13:35 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 04 18:13:35.271394 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-5748b5e8-4a7a-4098-b328-4dc42603a354 tempest-VolumesNegativeTest-1871903146 tempest-VolumesNegativeTest-1871903146-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003428 Feb 04 18:13:35.271910 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 610/1212] 10.222.0.98 () {58 vars in 1136 bytes} [Fri Feb 4 18:13:35 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 04 18:13:35.279583 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3762fa1b-9542-48b7-833f-49ee53748251 tempest-VolumesNegativeTest-1871903146 tempest-VolumesNegativeTest-1871903146-project] Calling method '.version_select at 0x7fe8cc8ed0d0>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:35.305726 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.wsgi [None req-3762fa1b-9542-48b7-833f-49ee53748251 tempest-VolumesNegativeTest-1871903146 tempest-VolumesNegativeTest-1871903146-project] HTTP exception thrown: Volume 1c3a3e71-684a-48c5-9266-1a00aa019deb could not be found. Feb 04 18:13:35.306318 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3762fa1b-9542-48b7-833f-49ee53748251 tempest-VolumesNegativeTest-1871903146 tempest-VolumesNegativeTest-1871903146-project] Returning 404 to user: Volume 1c3a3e71-684a-48c5-9266-1a00aa019deb could not be found. {{(pid=123567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:13:35.307167 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-3762fa1b-9542-48b7-833f-49ee53748251 tempest-VolumesNegativeTest-1871903146 tempest-VolumesNegativeTest-1871903146-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/1c3a3e71-684a-48c5-9266-1a00aa019deb" status: 404 len: 109 microversion: 2.1 time: 0.030823 Feb 04 18:13:35.307696 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 603/1213] 10.222.0.98 () {58 vars in 1247 bytes} [Fri Feb 4 18:13:35 2022] DELETE /compute/v2.1/os-volumes/1c3a3e71-684a-48c5-9266-1a00aa019deb => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:13:35.316506 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-080d08ad-d053-492a-9fec-6b5c9ca0d9a4 tempest-VolumesNegativeTest-1871903146 tempest-VolumesNegativeTest-1871903146-project] Calling method '.version_select at 0x7fe8cc0e9040>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:13:35.342379 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-080d08ad-d053-492a-9fec-6b5c9ca0d9a4 tempest-VolumesNegativeTest-1871903146 tempest-VolumesNegativeTest-1871903146-project] HTTP exception thrown: Volume 5ba674f1-a8a1-42a2-ada6-dbf67f71ddbb could not be found. Feb 04 18:13:35.343023 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-080d08ad-d053-492a-9fec-6b5c9ca0d9a4 tempest-VolumesNegativeTest-1871903146 tempest-VolumesNegativeTest-1871903146-project] Returning 404 to user: Volume 5ba674f1-a8a1-42a2-ada6-dbf67f71ddbb could not be found. {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:13:35.343880 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-080d08ad-d053-492a-9fec-6b5c9ca0d9a4 tempest-VolumesNegativeTest-1871903146 tempest-VolumesNegativeTest-1871903146-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/5ba674f1-a8a1-42a2-ada6-dbf67f71ddbb" status: 404 len: 109 microversion: 2.1 time: 0.031060 Feb 04 18:13:35.344421 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 611/1214] 10.222.0.98 () {58 vars in 1244 bytes} [Fri Feb 4 18:13:35 2022] GET /compute/v2.1/os-volumes/5ba674f1-a8a1-42a2-ada6-dbf67f71ddbb => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:14:15.811274 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-f42d5525-be2c-4e2b-9749-63361fe26f0a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:14:15.811861 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-f42d5525-be2c-4e2b-9749-63361fe26f0a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:14:15.818563 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f42d5525-be2c-4e2b-9749-63361fe26f0a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:15.819020 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f42d5525-be2c-4e2b-9749-63361fe26f0a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:15.819796 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f42d5525-be2c-4e2b-9749-63361fe26f0a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:15.820237 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f42d5525-be2c-4e2b-9749-63361fe26f0a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:15.847939 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-f42d5525-be2c-4e2b-9749-63361fe26f0a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c/os-volume_attachments/626170c1-8360-43a6-a73b-3e2a52538f9b" status: 200 len: 194 microversion: 2.1 time: 0.041184 Feb 04 18:14:15.848511 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 604/1215] 10.222.0.98 () {58 vars in 1412 bytes} [Fri Feb 4 18:14:15 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c/os-volume_attachments/626170c1-8360-43a6-a73b-3e2a52538f9b => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:14:15.859487 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-1c9e0285-6c53-45a8-bb93-4e084cb020a2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:14:15.860272 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-1c9e0285-6c53-45a8-bb93-4e084cb020a2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:14:15.866107 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1c9e0285-6c53-45a8-bb93-4e084cb020a2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:15.866594 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1c9e0285-6c53-45a8-bb93-4e084cb020a2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:15.867367 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1c9e0285-6c53-45a8-bb93-4e084cb020a2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:15.867801 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1c9e0285-6c53-45a8-bb93-4e084cb020a2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:15.943840 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.objects.instance [None req-1c9e0285-6c53-45a8-bb93-4e084cb020a2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lazy-loading 'services' on Instance uuid fdbc5838-213f-4ce8-8628-2c180bc6b92c {{(pid=123566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:14:16.150809 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-1c9e0285-6c53-45a8-bb93-4e084cb020a2 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "DELETE /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c/os-volume_attachments/626170c1-8360-43a6-a73b-3e2a52538f9b" status: 202 len: 0 microversion: 2.1 time: 0.296430 Feb 04 18:14:16.153430 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 612/1216] 10.222.0.98 () {58 vars in 1415 bytes} [Fri Feb 4 18:14:15 2022] DELETE /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c/os-volume_attachments/626170c1-8360-43a6-a73b-3e2a52538f9b => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 04 18:14:18.305093 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-faf6f38e-08d1-4555-bbfd-127a731a1e9e tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:14:18.305608 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-faf6f38e-08d1-4555-bbfd-127a731a1e9e tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:14:18.311997 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-faf6f38e-08d1-4555-bbfd-127a731a1e9e tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:18.312439 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-faf6f38e-08d1-4555-bbfd-127a731a1e9e tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:18.313260 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-faf6f38e-08d1-4555-bbfd-127a731a1e9e tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:18.313693 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-faf6f38e-08d1-4555-bbfd-127a731a1e9e tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:18.342979 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-faf6f38e-08d1-4555-bbfd-127a731a1e9e tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c/os-volume_attachments/3f728847-2c75-43b1-a947-78ceca2e48e8" status: 200 len: 194 microversion: 2.1 time: 0.041676 Feb 04 18:14:18.343554 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 605/1217] 10.222.0.98 () {58 vars in 1412 bytes} [Fri Feb 4 18:14:18 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c/os-volume_attachments/3f728847-2c75-43b1-a947-78ceca2e48e8 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:14:18.354149 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-d1b76009-8f27-4f3d-8b2c-dfa7a9f0e483 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:14:18.355156 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-d1b76009-8f27-4f3d-8b2c-dfa7a9f0e483 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:14:18.361548 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d1b76009-8f27-4f3d-8b2c-dfa7a9f0e483 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:18.361865 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d1b76009-8f27-4f3d-8b2c-dfa7a9f0e483 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:18.362691 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d1b76009-8f27-4f3d-8b2c-dfa7a9f0e483 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:18.363134 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d1b76009-8f27-4f3d-8b2c-dfa7a9f0e483 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:18.438712 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.objects.instance [None req-d1b76009-8f27-4f3d-8b2c-dfa7a9f0e483 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lazy-loading 'services' on Instance uuid fdbc5838-213f-4ce8-8628-2c180bc6b92c {{(pid=123566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:14:18.722116 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-d1b76009-8f27-4f3d-8b2c-dfa7a9f0e483 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "DELETE /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c/os-volume_attachments/3f728847-2c75-43b1-a947-78ceca2e48e8" status: 202 len: 0 microversion: 2.1 time: 0.372327 Feb 04 18:14:18.722754 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 613/1218] 10.222.0.98 () {58 vars in 1415 bytes} [Fri Feb 4 18:14:18 2022] DELETE /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c/os-volume_attachments/3f728847-2c75-43b1-a947-78ceca2e48e8 => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 04 18:14:20.920546 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-55787015-1f40-4744-8731-16ba6907cac1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:14:20.921461 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-55787015-1f40-4744-8731-16ba6907cac1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:14:20.927601 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-55787015-1f40-4744-8731-16ba6907cac1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:20.928067 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-55787015-1f40-4744-8731-16ba6907cac1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:20.928852 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-55787015-1f40-4744-8731-16ba6907cac1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:20.929289 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-55787015-1f40-4744-8731-16ba6907cac1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:20.958712 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-55787015-1f40-4744-8731-16ba6907cac1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042055 Feb 04 18:14:20.959268 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 606/1219] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:14:20 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 04 18:14:21.058124 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-612e845a-6ecc-4cf2-81ae-d980b3b4c094 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:14:21.059057 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-612e845a-6ecc-4cf2-81ae-d980b3b4c094 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:14:21.065533 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-612e845a-6ecc-4cf2-81ae-d980b3b4c094 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:21.065978 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-612e845a-6ecc-4cf2-81ae-d980b3b4c094 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:21.066784 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-612e845a-6ecc-4cf2-81ae-d980b3b4c094 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:21.067258 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-612e845a-6ecc-4cf2-81ae-d980b3b4c094 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:21.095759 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-612e845a-6ecc-4cf2-81ae-d980b3b4c094 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042315 Feb 04 18:14:21.096513 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 614/1220] 10.222.0.98 () {58 vars in 1301 bytes} [Fri Feb 4 18:14:21 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 04 18:14:21.155538 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-4939d384-67d2-4b2d-b61f-74737d07779d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:14:21.156044 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-4939d384-67d2-4b2d-b61f-74737d07779d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:14:21.162711 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4939d384-67d2-4b2d-b61f-74737d07779d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:21.163174 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4939d384-67d2-4b2d-b61f-74737d07779d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:21.163987 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4939d384-67d2-4b2d-b61f-74737d07779d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:21.164426 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-4939d384-67d2-4b2d-b61f-74737d07779d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:21.189840 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-4939d384-67d2-4b2d-b61f-74737d07779d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Going to try to terminate instance {{(pid=123567) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 04 18:14:21.562204 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-4939d384-67d2-4b2d-b61f-74737d07779d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "DELETE /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 204 len: 0 microversion: 2.1 time: 0.410004 Feb 04 18:14:21.563316 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 607/1221] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Feb 4 18:14:21 2022] DELETE /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 04 18:14:21.571453 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-75e4bca1-86e4-4d44-943c-df8cacb729e8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:14:21.572122 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-75e4bca1-86e4-4d44-943c-df8cacb729e8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:14:21.577972 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-75e4bca1-86e4-4d44-943c-df8cacb729e8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:21.578984 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-75e4bca1-86e4-4d44-943c-df8cacb729e8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:21.579758 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-75e4bca1-86e4-4d44-943c-df8cacb729e8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:21.580200 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-75e4bca1-86e4-4d44-943c-df8cacb729e8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:21.717433 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-75e4bca1-86e4-4d44-943c-df8cacb729e8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:14:21.724924 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-75e4bca1-86e4-4d44-943c-df8cacb729e8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 200 len: 1674 microversion: 2.1 time: 0.157212 Feb 04 18:14:21.725489 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 615/1222] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:14:21 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:14:22.743531 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-b6786614-b60d-41b1-a7e4-665324155711 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:14:22.744235 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-b6786614-b60d-41b1-a7e4-665324155711 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:14:22.751200 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b6786614-b60d-41b1-a7e4-665324155711 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:22.751659 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b6786614-b60d-41b1-a7e4-665324155711 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:22.752615 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b6786614-b60d-41b1-a7e4-665324155711 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:22.753056 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-b6786614-b60d-41b1-a7e4-665324155711 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:22.889621 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-b6786614-b60d-41b1-a7e4-665324155711 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:14:22.897088 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-b6786614-b60d-41b1-a7e4-665324155711 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 200 len: 1674 microversion: 2.1 time: 0.157700 Feb 04 18:14:22.897663 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 608/1223] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:14:22 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:14:23.914010 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-3c465963-439b-463c-88a8-54184c4f469d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:14:23.914652 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-3c465963-439b-463c-88a8-54184c4f469d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:14:23.920976 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3c465963-439b-463c-88a8-54184c4f469d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:23.921436 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3c465963-439b-463c-88a8-54184c4f469d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:23.922217 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3c465963-439b-463c-88a8-54184c4f469d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:23.922682 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3c465963-439b-463c-88a8-54184c4f469d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:24.053711 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-3c465963-439b-463c-88a8-54184c4f469d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:14:24.061078 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-3c465963-439b-463c-88a8-54184c4f469d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 200 len: 1674 microversion: 2.1 time: 0.150802 Feb 04 18:14:24.061651 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 616/1224] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:14:23 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:14:25.078791 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-1bc0a1a8-2206-455d-9077-fca1bfeb77c8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:14:25.079957 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-1bc0a1a8-2206-455d-9077-fca1bfeb77c8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:14:25.086133 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1bc0a1a8-2206-455d-9077-fca1bfeb77c8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:25.086619 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1bc0a1a8-2206-455d-9077-fca1bfeb77c8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:25.087381 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1bc0a1a8-2206-455d-9077-fca1bfeb77c8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:25.087813 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1bc0a1a8-2206-455d-9077-fca1bfeb77c8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:25.221659 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-1bc0a1a8-2206-455d-9077-fca1bfeb77c8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:14:25.230995 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-1bc0a1a8-2206-455d-9077-fca1bfeb77c8 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 200 len: 1674 microversion: 2.1 time: 0.155941 Feb 04 18:14:25.232054 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 609/1225] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:14:25 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:14:26.248106 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-181ddf99-e5fe-4e85-bc14-7bc3ed1139d1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:14:26.248723 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-181ddf99-e5fe-4e85-bc14-7bc3ed1139d1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:14:26.255204 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-181ddf99-e5fe-4e85-bc14-7bc3ed1139d1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:26.255658 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-181ddf99-e5fe-4e85-bc14-7bc3ed1139d1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:26.256431 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-181ddf99-e5fe-4e85-bc14-7bc3ed1139d1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:26.256874 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-181ddf99-e5fe-4e85-bc14-7bc3ed1139d1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:26.388862 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-181ddf99-e5fe-4e85-bc14-7bc3ed1139d1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:14:26.396760 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-181ddf99-e5fe-4e85-bc14-7bc3ed1139d1 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 200 len: 1674 microversion: 2.1 time: 0.152262 Feb 04 18:14:26.397303 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 617/1226] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:14:26 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:14:27.413188 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-8dd19372-a531-4a64-b33a-5a661e698f7a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:14:27.413789 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-8dd19372-a531-4a64-b33a-5a661e698f7a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:14:27.420141 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8dd19372-a531-4a64-b33a-5a661e698f7a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:27.420588 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8dd19372-a531-4a64-b33a-5a661e698f7a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:27.421367 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8dd19372-a531-4a64-b33a-5a661e698f7a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:27.421941 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-8dd19372-a531-4a64-b33a-5a661e698f7a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:27.559522 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-8dd19372-a531-4a64-b33a-5a661e698f7a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:14:27.567626 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-8dd19372-a531-4a64-b33a-5a661e698f7a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 200 len: 1674 microversion: 2.1 time: 0.158109 Feb 04 18:14:27.568209 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 610/1227] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:14:27 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:14:28.584623 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-2cb80c80-eae8-492b-91f2-6e1a14ba305a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:14:28.585333 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-2cb80c80-eae8-492b-91f2-6e1a14ba305a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:14:28.591912 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2cb80c80-eae8-492b-91f2-6e1a14ba305a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:28.592609 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2cb80c80-eae8-492b-91f2-6e1a14ba305a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:28.593405 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2cb80c80-eae8-492b-91f2-6e1a14ba305a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:28.593844 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-2cb80c80-eae8-492b-91f2-6e1a14ba305a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:28.644892 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-c1872eca-afdf-44c4-ad5e-ae622ac928e9 req-42f12671-cb68-4304-a438-7e21d2eb3234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdbc5838-213f-4ce8-8628-2c180bc6b92c", "name": "network-vif-deleted", "tag": "1185b4cf-af56-43d5-94d4-dd578ae69eac"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:14:28.647576 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:14:28.647576 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:14:28.658597 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-2cb80c80-eae8-492b-91f2-6e1a14ba305a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ec1e932d7429a9319213a04eb7766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0ec68d2c474dbf8c692e362abd93cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:14:28.663743 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-c1872eca-afdf-44c4-ad5e-ae622ac928e9 req-42f12671-cb68-4304-a438-7e21d2eb3234 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:28.664187 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-c1872eca-afdf-44c4-ad5e-ae622ac928e9 req-42f12671-cb68-4304-a438-7e21d2eb3234 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:28.665954 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-2cb80c80-eae8-492b-91f2-6e1a14ba305a tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 200 len: 1607 microversion: 2.1 time: 0.085074 Feb 04 18:14:28.666559 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 618/1228] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:14:28 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 1607 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:14:28.677213 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-c1872eca-afdf-44c4-ad5e-ae622ac928e9 req-42f12671-cb68-4304-a438-7e21d2eb3234 service nova] Creating event network-vif-deleted:1185b4cf-af56-43d5-94d4-dd578ae69eac for instance fdbc5838-213f-4ce8-8628-2c180bc6b92c on hv-cinder-82276 Feb 04 18:14:28.683772 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-c1872eca-afdf-44c4-ad5e-ae622ac928e9 req-42f12671-cb68-4304-a438-7e21d2eb3234 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041590 Feb 04 18:14:28.686091 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 611/1229] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:14:29.683721 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-5a556e0c-c16f-4a29-9b06-b13a30dcb46d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:14:29.684264 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-5a556e0c-c16f-4a29-9b06-b13a30dcb46d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:14:29.691346 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5a556e0c-c16f-4a29-9b06-b13a30dcb46d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:29.691792 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5a556e0c-c16f-4a29-9b06-b13a30dcb46d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:29.692571 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5a556e0c-c16f-4a29-9b06-b13a30dcb46d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:29.693063 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5a556e0c-c16f-4a29-9b06-b13a30dcb46d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:29.707913 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-5a556e0c-c16f-4a29-9b06-b13a30dcb46d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] HTTP exception thrown: Instance fdbc5838-213f-4ce8-8628-2c180bc6b92c could not be found. Feb 04 18:14:29.711376 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-5a556e0c-c16f-4a29-9b06-b13a30dcb46d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Returning 404 to user: Instance fdbc5838-213f-4ce8-8628-2c180bc6b92c could not be found. {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:14:29.711376 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-5a556e0c-c16f-4a29-9b06-b13a30dcb46d tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 404 len: 111 microversion: 2.1 time: 0.029624 Feb 04 18:14:29.711376 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 619/1230] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:14:29 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:14:29.719813 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-2179041f-2f32-4191-bbe3-2c6d034bbd22 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '.version_select at 0x7fe8ccb8b940>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:14:29.861395 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-2179041f-2f32-4191-bbe3-2c6d034bbd22 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1696882358" status: 202 len: 0 microversion: 2.1 time: 0.146033 Feb 04 18:14:29.862038 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 612/1231] 10.222.0.98 () {58 vars in 1220 bytes} [Fri Feb 4 18:14:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1696882358 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 04 18:14:33.365758 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-cfb2b0c9-ef62-41b8-bc9b-19804cedd9ce tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:14:33.366290 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-cfb2b0c9-ef62-41b8-bc9b-19804cedd9ce tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:14:33.372530 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cfb2b0c9-ef62-41b8-bc9b-19804cedd9ce tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:33.372989 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cfb2b0c9-ef62-41b8-bc9b-19804cedd9ce tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:33.374663 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cfb2b0c9-ef62-41b8-bc9b-19804cedd9ce tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:33.374663 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-cfb2b0c9-ef62-41b8-bc9b-19804cedd9ce tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:33.387259 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-cfb2b0c9-ef62-41b8-bc9b-19804cedd9ce tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] HTTP exception thrown: Instance fdbc5838-213f-4ce8-8628-2c180bc6b92c could not be found. Feb 04 18:14:33.387838 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-cfb2b0c9-ef62-41b8-bc9b-19804cedd9ce tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Returning 404 to user: Instance fdbc5838-213f-4ce8-8628-2c180bc6b92c could not be found. {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:14:33.388682 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-cfb2b0c9-ef62-41b8-bc9b-19804cedd9ce tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "DELETE /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 404 len: 111 microversion: 2.1 time: 0.026611 Feb 04 18:14:33.389212 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 620/1232] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Feb 4 18:14:33 2022] DELETE /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:14:33.397767 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c2af9d66-c91a-4ea8-8076-c19daf6028f0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:14:33.398467 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c2af9d66-c91a-4ea8-8076-c19daf6028f0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: fdbc5838-213f-4ce8-8628-2c180bc6b92c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:14:33.404977 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c2af9d66-c91a-4ea8-8076-c19daf6028f0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:33.414987 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c2af9d66-c91a-4ea8-8076-c19daf6028f0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:33.414987 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c2af9d66-c91a-4ea8-8076-c19daf6028f0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:33.414987 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c2af9d66-c91a-4ea8-8076-c19daf6028f0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:33.419895 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.wsgi [None req-c2af9d66-c91a-4ea8-8076-c19daf6028f0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] HTTP exception thrown: Instance fdbc5838-213f-4ce8-8628-2c180bc6b92c could not be found. Feb 04 18:14:33.420476 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c2af9d66-c91a-4ea8-8076-c19daf6028f0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Returning 404 to user: Instance fdbc5838-213f-4ce8-8628-2c180bc6b92c could not be found. {{(pid=123567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:14:33.421294 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c2af9d66-c91a-4ea8-8076-c19daf6028f0 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c" status: 404 len: 111 microversion: 2.1 time: 0.027850 Feb 04 18:14:33.421826 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 613/1233] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:14:33 2022] GET /compute/v2.1/servers/fdbc5838-213f-4ce8-8628-2c180bc6b92c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:14:34.818376 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-f3aa73dd-0ea2-4dca-9adb-e25c9e675188 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:14:34.818376 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-f3aa73dd-0ea2-4dca-9adb-e25c9e675188 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:14:34.824801 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f3aa73dd-0ea2-4dca-9adb-e25c9e675188 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:34.825261 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f3aa73dd-0ea2-4dca-9adb-e25c9e675188 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:34.826056 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f3aa73dd-0ea2-4dca-9adb-e25c9e675188 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:34.826525 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f3aa73dd-0ea2-4dca-9adb-e25c9e675188 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:34.842017 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-f3aa73dd-0ea2-4dca-9adb-e25c9e675188 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] HTTP exception thrown: Instance 629aebef-875d-4e7d-b9e6-ab8e0195d62c could not be found. Feb 04 18:14:34.842650 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-f3aa73dd-0ea2-4dca-9adb-e25c9e675188 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Returning 404 to user: Instance 629aebef-875d-4e7d-b9e6-ab8e0195d62c could not be found. {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:14:34.843489 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-f3aa73dd-0ea2-4dca-9adb-e25c9e675188 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "DELETE /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 404 len: 111 microversion: 2.1 time: 0.029895 Feb 04 18:14:34.847433 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 621/1234] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Feb 4 18:14:34 2022] DELETE /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:14:34.852307 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-282b4e5c-ef11-4f3b-b1af-2f431e503f14 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:14:34.852959 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-282b4e5c-ef11-4f3b-b1af-2f431e503f14 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] [instance: 629aebef-875d-4e7d-b9e6-ab8e0195d62c] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:14:34.859754 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-282b4e5c-ef11-4f3b-b1af-2f431e503f14 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:34.860770 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-282b4e5c-ef11-4f3b-b1af-2f431e503f14 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:34.861563 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-282b4e5c-ef11-4f3b-b1af-2f431e503f14 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:14:34.862008 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-282b4e5c-ef11-4f3b-b1af-2f431e503f14 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:14:34.875153 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.wsgi [None req-282b4e5c-ef11-4f3b-b1af-2f431e503f14 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] HTTP exception thrown: Instance 629aebef-875d-4e7d-b9e6-ab8e0195d62c could not be found. Feb 04 18:14:34.875741 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-282b4e5c-ef11-4f3b-b1af-2f431e503f14 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] Returning 404 to user: Instance 629aebef-875d-4e7d-b9e6-ab8e0195d62c could not be found. {{(pid=123567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:14:34.876881 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-282b4e5c-ef11-4f3b-b1af-2f431e503f14 tempest-AttachVolumeTestJSON-990568496 tempest-AttachVolumeTestJSON-990568496-project] 10.222.0.98 "GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c" status: 404 len: 111 microversion: 2.1 time: 0.028248 Feb 04 18:14:34.877421 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 614/1235] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:14:34 2022] GET /compute/v2.1/servers/629aebef-875d-4e7d-b9e6-ab8e0195d62c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:15:18.162605 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-6702daec-9b62-4c43-8a63-12d22965b2f7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:18.163152 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-6702daec-9b62-4c43-8a63-12d22965b2f7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:18.169002 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6702daec-9b62-4c43-8a63-12d22965b2f7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:18.169452 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6702daec-9b62-4c43-8a63-12d22965b2f7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:18.170230 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6702daec-9b62-4c43-8a63-12d22965b2f7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:18.170702 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6702daec-9b62-4c43-8a63-12d22965b2f7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:18.196009 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-6702daec-9b62-4c43-8a63-12d22965b2f7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Going to try to terminate instance {{(pid=123566) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 04 18:15:18.473244 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-6702daec-9b62-4c43-8a63-12d22965b2f7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "DELETE /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 204 len: 0 microversion: 2.1 time: 0.314229 Feb 04 18:15:18.473833 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 622/1236] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Feb 4 18:15:18 2022] DELETE /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 04 18:15:18.481743 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-2ee635d0-e556-4818-95ff-cf0b00140896 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:18.482514 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-2ee635d0-e556-4818-95ff-cf0b00140896 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:18.488900 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2ee635d0-e556-4818-95ff-cf0b00140896 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:18.489365 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2ee635d0-e556-4818-95ff-cf0b00140896 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:18.490190 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2ee635d0-e556-4818-95ff-cf0b00140896 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:18.490663 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2ee635d0-e556-4818-95ff-cf0b00140896 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:18.624235 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-2ee635d0-e556-4818-95ff-cf0b00140896 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:18.631933 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-2ee635d0-e556-4818-95ff-cf0b00140896 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1577 microversion: 2.1 time: 0.153919 Feb 04 18:15:18.632505 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 615/1237] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:18 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:15:19.650960 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-471d3b28-c313-4c46-97fd-d44fdbc9c3c3 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:19.651580 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-471d3b28-c313-4c46-97fd-d44fdbc9c3c3 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:19.658854 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-471d3b28-c313-4c46-97fd-d44fdbc9c3c3 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:19.659302 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-471d3b28-c313-4c46-97fd-d44fdbc9c3c3 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:19.660076 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-471d3b28-c313-4c46-97fd-d44fdbc9c3c3 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:19.660519 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-471d3b28-c313-4c46-97fd-d44fdbc9c3c3 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:19.797903 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-471d3b28-c313-4c46-97fd-d44fdbc9c3c3 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:19.805168 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-471d3b28-c313-4c46-97fd-d44fdbc9c3c3 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1577 microversion: 2.1 time: 0.158676 Feb 04 18:15:19.805726 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 623/1238] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:19 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:15:20.822174 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3ef84dcf-a3fa-4b6c-afef-e99d959804e3 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:20.822821 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-3ef84dcf-a3fa-4b6c-afef-e99d959804e3 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:20.828828 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3ef84dcf-a3fa-4b6c-afef-e99d959804e3 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:20.829281 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3ef84dcf-a3fa-4b6c-afef-e99d959804e3 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:20.830060 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3ef84dcf-a3fa-4b6c-afef-e99d959804e3 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:20.830528 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3ef84dcf-a3fa-4b6c-afef-e99d959804e3 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:20.963389 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-3ef84dcf-a3fa-4b6c-afef-e99d959804e3 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:20.970703 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-3ef84dcf-a3fa-4b6c-afef-e99d959804e3 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1577 microversion: 2.1 time: 0.152388 Feb 04 18:15:20.971272 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 616/1239] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:20 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:15:21.988636 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-7d1fb136-5748-4a48-be7b-e1b94a9e8e61 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:21.989271 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-7d1fb136-5748-4a48-be7b-e1b94a9e8e61 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:21.995533 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7d1fb136-5748-4a48-be7b-e1b94a9e8e61 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:21.995986 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7d1fb136-5748-4a48-be7b-e1b94a9e8e61 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:21.996815 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7d1fb136-5748-4a48-be7b-e1b94a9e8e61 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:21.997260 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7d1fb136-5748-4a48-be7b-e1b94a9e8e61 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:22.129180 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-7d1fb136-5748-4a48-be7b-e1b94a9e8e61 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:22.136383 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-7d1fb136-5748-4a48-be7b-e1b94a9e8e61 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1577 microversion: 2.1 time: 0.152101 Feb 04 18:15:22.136940 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 624/1240] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:21 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:15:23.152700 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-384effa1-7910-4c37-b3dc-ca5d9887440e tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:23.153318 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-384effa1-7910-4c37-b3dc-ca5d9887440e tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:23.160291 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-384effa1-7910-4c37-b3dc-ca5d9887440e tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:23.160748 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-384effa1-7910-4c37-b3dc-ca5d9887440e tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:23.161526 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-384effa1-7910-4c37-b3dc-ca5d9887440e tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:23.161993 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-384effa1-7910-4c37-b3dc-ca5d9887440e tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:23.297887 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-384effa1-7910-4c37-b3dc-ca5d9887440e tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:23.305705 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-384effa1-7910-4c37-b3dc-ca5d9887440e tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1577 microversion: 2.1 time: 0.156614 Feb 04 18:15:23.306255 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 617/1241] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:23 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:15:24.323344 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-0bd90743-18e2-45a7-98ec-c4eeaec6946f tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:24.323957 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-0bd90743-18e2-45a7-98ec-c4eeaec6946f tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:24.330311 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0bd90743-18e2-45a7-98ec-c4eeaec6946f tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:24.330809 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0bd90743-18e2-45a7-98ec-c4eeaec6946f tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:24.331589 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0bd90743-18e2-45a7-98ec-c4eeaec6946f tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:24.332032 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-0bd90743-18e2-45a7-98ec-c4eeaec6946f tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:24.464684 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-0bd90743-18e2-45a7-98ec-c4eeaec6946f tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:24.472059 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-0bd90743-18e2-45a7-98ec-c4eeaec6946f tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1577 microversion: 2.1 time: 0.152589 Feb 04 18:15:24.472615 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 625/1242] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:24 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:15:25.489330 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e1f6827e-d0dd-46c1-a78c-2fc7066f5b9d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:25.489941 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-e1f6827e-d0dd-46c1-a78c-2fc7066f5b9d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:25.497216 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e1f6827e-d0dd-46c1-a78c-2fc7066f5b9d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:25.497656 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e1f6827e-d0dd-46c1-a78c-2fc7066f5b9d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:25.498443 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e1f6827e-d0dd-46c1-a78c-2fc7066f5b9d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:25.498882 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e1f6827e-d0dd-46c1-a78c-2fc7066f5b9d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:25.634130 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e1f6827e-d0dd-46c1-a78c-2fc7066f5b9d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:25.641601 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e1f6827e-d0dd-46c1-a78c-2fc7066f5b9d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1577 microversion: 2.1 time: 0.155827 Feb 04 18:15:25.642208 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 618/1243] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:25 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:15:26.658936 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-bdc0881c-81bb-4fdd-bf1b-91915172bb2c tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:26.659531 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-bdc0881c-81bb-4fdd-bf1b-91915172bb2c tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:26.665693 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bdc0881c-81bb-4fdd-bf1b-91915172bb2c tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:26.666135 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bdc0881c-81bb-4fdd-bf1b-91915172bb2c tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:26.666929 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bdc0881c-81bb-4fdd-bf1b-91915172bb2c tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:26.667357 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-bdc0881c-81bb-4fdd-bf1b-91915172bb2c tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:26.799081 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-bdc0881c-81bb-4fdd-bf1b-91915172bb2c tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:26.806341 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-bdc0881c-81bb-4fdd-bf1b-91915172bb2c tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1577 microversion: 2.1 time: 0.151660 Feb 04 18:15:26.806938 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 626/1244] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:26 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:15:27.823224 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-0060e840-e419-4813-af70-e36944fbcfee tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:27.823837 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-0060e840-e419-4813-af70-e36944fbcfee tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:27.830840 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0060e840-e419-4813-af70-e36944fbcfee tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:27.831640 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0060e840-e419-4813-af70-e36944fbcfee tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:27.832068 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0060e840-e419-4813-af70-e36944fbcfee tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:27.832509 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0060e840-e419-4813-af70-e36944fbcfee tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:27.967866 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-0060e840-e419-4813-af70-e36944fbcfee tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:27.975196 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-0060e840-e419-4813-af70-e36944fbcfee tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1577 microversion: 2.1 time: 0.155709 Feb 04 18:15:27.975766 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 619/1245] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:27 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:15:28.992325 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-198c74aa-1733-4361-a3d9-ebcd671fd094 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:28.992973 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-198c74aa-1733-4361-a3d9-ebcd671fd094 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:28.999282 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-198c74aa-1733-4361-a3d9-ebcd671fd094 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:28.999770 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-198c74aa-1733-4361-a3d9-ebcd671fd094 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:29.001083 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-198c74aa-1733-4361-a3d9-ebcd671fd094 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:29.001509 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-198c74aa-1733-4361-a3d9-ebcd671fd094 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:29.137984 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-198c74aa-1733-4361-a3d9-ebcd671fd094 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:29.147440 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-198c74aa-1733-4361-a3d9-ebcd671fd094 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1577 microversion: 2.1 time: 0.158826 Feb 04 18:15:29.148021 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 627/1246] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:28 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:15:30.025012 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-52a0cdb1-40d3-4b6a-a6bf-ee1f9977db62 req-54ead3fa-f55e-47b1-b7c5-c04c3cfb914b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe11be94-d623-43fe-9319-e6ea69528e71", "name": "network-vif-deleted", "tag": "dcde5d5f-cc5d-4e44-a5cf-d8366abf9c4a"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:15:30.026651 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:15:30.026651 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:15:30.034556 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-52a0cdb1-40d3-4b6a-a6bf-ee1f9977db62 req-54ead3fa-f55e-47b1-b7c5-c04c3cfb914b service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:30.035084 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-52a0cdb1-40d3-4b6a-a6bf-ee1f9977db62 req-54ead3fa-f55e-47b1-b7c5-c04c3cfb914b service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:30.050315 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-52a0cdb1-40d3-4b6a-a6bf-ee1f9977db62 req-54ead3fa-f55e-47b1-b7c5-c04c3cfb914b service nova] Creating event network-vif-deleted:dcde5d5f-cc5d-4e44-a5cf-d8366abf9c4a for instance fe11be94-d623-43fe-9319-e6ea69528e71 on hv-cinder-82276 Feb 04 18:15:30.056791 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-52a0cdb1-40d3-4b6a-a6bf-ee1f9977db62 req-54ead3fa-f55e-47b1-b7c5-c04c3cfb914b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035950 Feb 04 18:15:30.061035 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 620/1247] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:15:30.164835 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-7f0db285-49a7-48c0-8301-c347ddf06c53 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:30.165617 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-7f0db285-49a7-48c0-8301-c347ddf06c53 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:30.173048 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7f0db285-49a7-48c0-8301-c347ddf06c53 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:30.173605 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7f0db285-49a7-48c0-8301-c347ddf06c53 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:30.174591 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7f0db285-49a7-48c0-8301-c347ddf06c53 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:30.175118 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-7f0db285-49a7-48c0-8301-c347ddf06c53 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:30.246259 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-7f0db285-49a7-48c0-8301-c347ddf06c53 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:30.257329 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-7f0db285-49a7-48c0-8301-c347ddf06c53 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1510 microversion: 2.1 time: 0.096331 Feb 04 18:15:30.258041 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 628/1248] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:30 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1510 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:15:31.274746 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-d13ed1ce-6769-4208-b8b5-0a2f91b608f9 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:31.275464 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-d13ed1ce-6769-4208-b8b5-0a2f91b608f9 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:31.282981 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d13ed1ce-6769-4208-b8b5-0a2f91b608f9 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:31.283437 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d13ed1ce-6769-4208-b8b5-0a2f91b608f9 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:31.286144 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d13ed1ce-6769-4208-b8b5-0a2f91b608f9 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:31.286144 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d13ed1ce-6769-4208-b8b5-0a2f91b608f9 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:31.317054 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d13ed1ce-6769-4208-b8b5-0a2f91b608f9 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:31.317508 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-d13ed1ce-6769-4208-b8b5-0a2f91b608f9 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:31.318008 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.objects.instance [None req-d13ed1ce-6769-4208-b8b5-0a2f91b608f9 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lazy-loading 'fault' on Instance uuid fe11be94-d623-43fe-9319-e6ea69528e71 {{(pid=123567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:15:31.357513 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-d13ed1ce-6769-4208-b8b5-0a2f91b608f9 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:31.365809 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-d13ed1ce-6769-4208-b8b5-0a2f91b608f9 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 200 len: 1231 microversion: 2.1 time: 0.095593 Feb 04 18:15:31.366391 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 621/1249] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:31 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 1231 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:15:32.382702 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-9866d8aa-3822-4ac6-a8c3-30c69d616228 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:32.383486 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-9866d8aa-3822-4ac6-a8c3-30c69d616228 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:32.389545 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9866d8aa-3822-4ac6-a8c3-30c69d616228 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:32.389998 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9866d8aa-3822-4ac6-a8c3-30c69d616228 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:32.390809 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9866d8aa-3822-4ac6-a8c3-30c69d616228 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:32.391251 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9866d8aa-3822-4ac6-a8c3-30c69d616228 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:32.404462 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-9866d8aa-3822-4ac6-a8c3-30c69d616228 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] HTTP exception thrown: Instance fe11be94-d623-43fe-9319-e6ea69528e71 could not be found. Feb 04 18:15:32.405043 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-9866d8aa-3822-4ac6-a8c3-30c69d616228 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Returning 404 to user: Instance fe11be94-d623-43fe-9319-e6ea69528e71 could not be found. {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:15:32.406466 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-9866d8aa-3822-4ac6-a8c3-30c69d616228 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 404 len: 111 microversion: 2.1 time: 0.026957 Feb 04 18:15:32.407000 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 629/1250] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:32 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:15:32.503071 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-50adf0a6-f0e0-4b2e-ae8c-7621595d4896 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1237304441", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1196483484", "security_groups": [{"name": "tempest-secgroup-smoke-453985264"}], "block_device_mapping_v2": [{"uuid": "b2201eab-22f0-4783-be09-4f9c2234d8d7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c2f9ed8d-fda8-42c7-8ea1-cd07bcb8b632"}]}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:15:32.638292 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.network.neutron [None req-50adf0a6-f0e0-4b2e-ae8c-7621595d4896 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] validate_networks() for [('c2f9ed8d-fda8-42c7-8ea1-cd07bcb8b632', None, None, None, None, None)] {{(pid=123567) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 04 18:15:33.005695 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-50adf0a6-f0e0-4b2e-ae8c-7621595d4896 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Flavor limits 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 04 18:15:33.006134 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-50adf0a6-f0e0-4b2e-ae8c-7621595d4896 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Image limits 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 04 18:15:33.006643 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-50adf0a6-f0e0-4b2e-ae8c-7621595d4896 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Flavor pref 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 04 18:15:33.007058 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-50adf0a6-f0e0-4b2e-ae8c-7621595d4896 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Image pref 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 04 18:15:33.007492 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-50adf0a6-f0e0-4b2e-ae8c-7621595d4896 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 04 18:15:33.016085 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-50adf0a6-f0e0-4b2e-ae8c-7621595d4896 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:33.016627 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-50adf0a6-f0e0-4b2e-ae8c-7621595d4896 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:33.017505 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-50adf0a6-f0e0-4b2e-ae8c-7621595d4896 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:33.017949 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-50adf0a6-f0e0-4b2e-ae8c-7621595d4896 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:33.033750 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-50adf0a6-f0e0-4b2e-ae8c-7621595d4896 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Getting quotas for project 7f2ff016321049ceb841522b8fe2c27a. Resources: {'cores', 'ram', 'instances'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:15:33.038682 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-50adf0a6-f0e0-4b2e-ae8c-7621595d4896 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Getting quotas for user 508cd118fbdd432491f2e778e789473d and project 7f2ff016321049ceb841522b8fe2c27a. Resources: {'cores', 'ram', 'instances'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:15:33.096567 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-50adf0a6-f0e0-4b2e-ae8c-7621595d4896 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Going to run 1 instances... {{(pid=123567) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 04 18:15:33.101832 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-50adf0a6-f0e0-4b2e-ae8c-7621595d4896 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: bb8c372c-53a6-4aec-8c97-08c8af67c775] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b2201eab-22f0-4783-be09-4f9c2234d8d7',volume_size=None,volume_type=None)] {{(pid=123567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 04 18:15:33.570841 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-50adf0a6-f0e0-4b2e-ae8c-7621595d4896 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [8c358e2a-d804-4cd7-a529-7dc771b24ffc] AMQP server on 10.222.0.98:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 04 18:15:34.579332 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO oslo.messaging._drivers.impl_rabbit [None req-50adf0a6-f0e0-4b2e-ae8c-7621595d4896 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [8c358e2a-d804-4cd7-a529-7dc771b24ffc] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 35376. Feb 04 18:15:34.584229 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-50adf0a6-f0e0-4b2e-ae8c-7621595d4896 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.085002 Feb 04 18:15:34.585056 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 622/1251] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Feb 4 18:15:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 2087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 04 18:15:34.595399 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-c91aaa7e-89aa-41e2-8586-f1c8248d5ed6 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:34.596165 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-c91aaa7e-89aa-41e2-8586-f1c8248d5ed6 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: bb8c372c-53a6-4aec-8c97-08c8af67c775] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:34.666684 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-c91aaa7e-89aa-41e2-8586-f1c8248d5ed6 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:34.673384 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-c91aaa7e-89aa-41e2-8586-f1c8248d5ed6 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775" status: 200 len: 1095 microversion: 2.1 time: 0.082067 Feb 04 18:15:34.673894 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 630/1252] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:34 2022] GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775 => generated 1095 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:15:35.690865 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3732d057-e1a1-4390-80ea-3d23504a3cc5 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:35.691484 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-3732d057-e1a1-4390-80ea-3d23504a3cc5 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: bb8c372c-53a6-4aec-8c97-08c8af67c775] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:35.697603 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3732d057-e1a1-4390-80ea-3d23504a3cc5 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:35.698122 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3732d057-e1a1-4390-80ea-3d23504a3cc5 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:35.698938 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3732d057-e1a1-4390-80ea-3d23504a3cc5 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:35.699383 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3732d057-e1a1-4390-80ea-3d23504a3cc5 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:35.758370 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-3732d057-e1a1-4390-80ea-3d23504a3cc5 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:35.766481 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-3732d057-e1a1-4390-80ea-3d23504a3cc5 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775" status: 200 len: 1145 microversion: 2.1 time: 0.080283 Feb 04 18:15:35.771186 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 623/1253] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:35 2022] GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:15:36.783249 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-9223f229-0b45-4b71-a249-a543330f9939 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:36.783863 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-9223f229-0b45-4b71-a249-a543330f9939 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: bb8c372c-53a6-4aec-8c97-08c8af67c775] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:36.790832 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9223f229-0b45-4b71-a249-a543330f9939 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:36.791292 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9223f229-0b45-4b71-a249-a543330f9939 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:36.792145 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9223f229-0b45-4b71-a249-a543330f9939 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:36.792588 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9223f229-0b45-4b71-a249-a543330f9939 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:36.854252 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-9223f229-0b45-4b71-a249-a543330f9939 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:36.862625 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-9223f229-0b45-4b71-a249-a543330f9939 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775" status: 200 len: 1193 microversion: 2.1 time: 0.083075 Feb 04 18:15:36.863199 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 631/1254] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:36 2022] GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775 => generated 1193 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:15:37.885270 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-2c722925-e83d-43f2-b8ad-6a6d244ffe48 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:37.886040 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-2c722925-e83d-43f2-b8ad-6a6d244ffe48 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: bb8c372c-53a6-4aec-8c97-08c8af67c775] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:37.893819 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2c722925-e83d-43f2-b8ad-6a6d244ffe48 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:37.895596 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2c722925-e83d-43f2-b8ad-6a6d244ffe48 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:37.895596 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2c722925-e83d-43f2-b8ad-6a6d244ffe48 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:37.895820 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2c722925-e83d-43f2-b8ad-6a6d244ffe48 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:38.034885 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-2c722925-e83d-43f2-b8ad-6a6d244ffe48 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:38.042252 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-2c722925-e83d-43f2-b8ad-6a6d244ffe48 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775" status: 200 len: 1278 microversion: 2.1 time: 0.160936 Feb 04 18:15:38.042947 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 624/1255] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:37 2022] GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:15:38.626293 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-b5f6e257-df63-4cf3-b0f0-7066ecd24dd3 req-d3eb89b3-785b-49f3-ae21-b3b11bac0235 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb8c372c-53a6-4aec-8c97-08c8af67c775", "tag": "98179b91-ea4a-4986-9a47-3e8973f618d3"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:15:38.627922 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:15:38.627922 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:15:38.635537 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-b5f6e257-df63-4cf3-b0f0-7066ecd24dd3 req-d3eb89b3-785b-49f3-ae21-b3b11bac0235 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:38.636866 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-b5f6e257-df63-4cf3-b0f0-7066ecd24dd3 req-d3eb89b3-785b-49f3-ae21-b3b11bac0235 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:38.653076 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-b5f6e257-df63-4cf3-b0f0-7066ecd24dd3 req-d3eb89b3-785b-49f3-ae21-b3b11bac0235 service nova] Creating event network-changed:98179b91-ea4a-4986-9a47-3e8973f618d3 for instance bb8c372c-53a6-4aec-8c97-08c8af67c775 on hv-cinder-82276 Feb 04 18:15:38.658692 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-b5f6e257-df63-4cf3-b0f0-7066ecd24dd3 req-d3eb89b3-785b-49f3-ae21-b3b11bac0235 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036458 Feb 04 18:15:38.659289 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 632/1256] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:15:39.058375 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-34ff17a5-970c-4f6f-8b7c-d3d9bfebaceb tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:39.059023 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-34ff17a5-970c-4f6f-8b7c-d3d9bfebaceb tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: bb8c372c-53a6-4aec-8c97-08c8af67c775] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:39.065909 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-34ff17a5-970c-4f6f-8b7c-d3d9bfebaceb tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:39.066407 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-34ff17a5-970c-4f6f-8b7c-d3d9bfebaceb tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:39.067161 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-34ff17a5-970c-4f6f-8b7c-d3d9bfebaceb tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:39.067605 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-34ff17a5-970c-4f6f-8b7c-d3d9bfebaceb tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:39.218950 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-34ff17a5-970c-4f6f-8b7c-d3d9bfebaceb tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:39.227516 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-34ff17a5-970c-4f6f-8b7c-d3d9bfebaceb tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775" status: 200 len: 1278 microversion: 2.1 time: 0.172501 Feb 04 18:15:39.228095 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 625/1257] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:39 2022] GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775 => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:15:40.245882 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-5c69c200-f84b-4c48-8f8f-b56d4d5d7f92 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:40.246565 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-5c69c200-f84b-4c48-8f8f-b56d4d5d7f92 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: bb8c372c-53a6-4aec-8c97-08c8af67c775] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:40.253140 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5c69c200-f84b-4c48-8f8f-b56d4d5d7f92 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:40.253589 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5c69c200-f84b-4c48-8f8f-b56d4d5d7f92 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:40.254357 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5c69c200-f84b-4c48-8f8f-b56d4d5d7f92 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:40.254821 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-5c69c200-f84b-4c48-8f8f-b56d4d5d7f92 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:40.388832 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-5c69c200-f84b-4c48-8f8f-b56d4d5d7f92 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:40.396108 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-5c69c200-f84b-4c48-8f8f-b56d4d5d7f92 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775" status: 200 len: 1266 microversion: 2.1 time: 0.154916 Feb 04 18:15:40.396672 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 633/1258] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:40 2022] GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:15:41.413185 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-3af7d316-e9f6-4219-a383-2c3b2c8ec413 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:41.413774 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-3af7d316-e9f6-4219-a383-2c3b2c8ec413 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: bb8c372c-53a6-4aec-8c97-08c8af67c775] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:41.420096 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3af7d316-e9f6-4219-a383-2c3b2c8ec413 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:41.420547 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3af7d316-e9f6-4219-a383-2c3b2c8ec413 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:41.421380 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3af7d316-e9f6-4219-a383-2c3b2c8ec413 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:41.421823 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-3af7d316-e9f6-4219-a383-2c3b2c8ec413 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:41.556453 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-3af7d316-e9f6-4219-a383-2c3b2c8ec413 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:41.564306 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-3af7d316-e9f6-4219-a383-2c3b2c8ec413 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775" status: 200 len: 1266 microversion: 2.1 time: 0.154911 Feb 04 18:15:41.564883 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 626/1259] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:41 2022] GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:15:42.581296 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-6bf36efd-fa92-4a3b-989d-e0fc806278c7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:42.581906 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-6bf36efd-fa92-4a3b-989d-e0fc806278c7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: bb8c372c-53a6-4aec-8c97-08c8af67c775] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:42.588135 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6bf36efd-fa92-4a3b-989d-e0fc806278c7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:42.588580 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6bf36efd-fa92-4a3b-989d-e0fc806278c7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:42.589351 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6bf36efd-fa92-4a3b-989d-e0fc806278c7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:42.589787 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6bf36efd-fa92-4a3b-989d-e0fc806278c7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:42.723108 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-6bf36efd-fa92-4a3b-989d-e0fc806278c7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:42.730245 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-6bf36efd-fa92-4a3b-989d-e0fc806278c7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775" status: 200 len: 1266 microversion: 2.1 time: 0.153132 Feb 04 18:15:42.730847 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 634/1260] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:42 2022] GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:15:43.747034 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e0609ef2-64df-49f8-860a-4b3af6ad8fe2 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:43.747644 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-e0609ef2-64df-49f8-860a-4b3af6ad8fe2 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: bb8c372c-53a6-4aec-8c97-08c8af67c775] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:43.754809 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e0609ef2-64df-49f8-860a-4b3af6ad8fe2 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:43.755257 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e0609ef2-64df-49f8-860a-4b3af6ad8fe2 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:43.756030 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e0609ef2-64df-49f8-860a-4b3af6ad8fe2 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:43.756467 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e0609ef2-64df-49f8-860a-4b3af6ad8fe2 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:43.888274 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e0609ef2-64df-49f8-860a-4b3af6ad8fe2 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:43.896261 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e0609ef2-64df-49f8-860a-4b3af6ad8fe2 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775" status: 200 len: 1266 microversion: 2.1 time: 0.152850 Feb 04 18:15:43.896840 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 627/1261] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:43 2022] GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:15:44.912670 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-6ea78677-93d7-40a8-baf9-04bf5744f1c6 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:44.913279 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-6ea78677-93d7-40a8-baf9-04bf5744f1c6 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: bb8c372c-53a6-4aec-8c97-08c8af67c775] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:44.919477 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6ea78677-93d7-40a8-baf9-04bf5744f1c6 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:44.919924 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6ea78677-93d7-40a8-baf9-04bf5744f1c6 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:44.920693 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6ea78677-93d7-40a8-baf9-04bf5744f1c6 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:44.921128 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6ea78677-93d7-40a8-baf9-04bf5744f1c6 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:45.059375 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-6ea78677-93d7-40a8-baf9-04bf5744f1c6 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:45.067136 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-6ea78677-93d7-40a8-baf9-04bf5744f1c6 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775" status: 200 len: 1266 microversion: 2.1 time: 0.158111 Feb 04 18:15:45.067701 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 635/1262] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:44 2022] GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:15:45.798385 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 04 18:15:45.798696 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: Fri Feb 4 18:15:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 04 18:15:46.083543 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-1b64c199-8e18-4ebc-9338-cf6c7372bf78 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:46.084094 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-1b64c199-8e18-4ebc-9338-cf6c7372bf78 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: bb8c372c-53a6-4aec-8c97-08c8af67c775] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:46.090279 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1b64c199-8e18-4ebc-9338-cf6c7372bf78 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:46.091539 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1b64c199-8e18-4ebc-9338-cf6c7372bf78 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:46.091539 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1b64c199-8e18-4ebc-9338-cf6c7372bf78 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:46.091912 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1b64c199-8e18-4ebc-9338-cf6c7372bf78 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:46.405388 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-1b64c199-8e18-4ebc-9338-cf6c7372bf78 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:46.413249 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-1b64c199-8e18-4ebc-9338-cf6c7372bf78 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775" status: 200 len: 1266 microversion: 2.1 time: 0.333492 Feb 04 18:15:46.413815 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 628/1263] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:46 2022] GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775 => generated 1266 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:15:47.429500 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ff01a7d6-79f5-40d0-a0c3-de7107e8bfda tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:47.430143 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ff01a7d6-79f5-40d0-a0c3-de7107e8bfda tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: bb8c372c-53a6-4aec-8c97-08c8af67c775] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:47.436424 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ff01a7d6-79f5-40d0-a0c3-de7107e8bfda tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:47.437537 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ff01a7d6-79f5-40d0-a0c3-de7107e8bfda tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:47.438325 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ff01a7d6-79f5-40d0-a0c3-de7107e8bfda tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:47.438789 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ff01a7d6-79f5-40d0-a0c3-de7107e8bfda tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:47.626770 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-ff01a7d6-79f5-40d0-a0c3-de7107e8bfda tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:47.634038 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ff01a7d6-79f5-40d0-a0c3-de7107e8bfda tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775" status: 200 len: 1266 microversion: 2.1 time: 0.208159 Feb 04 18:15:47.634634 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 636/1264] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:47 2022] GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:15:48.650765 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a13abd9d-162d-4487-9e39-02d064677d30 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:48.651383 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-a13abd9d-162d-4487-9e39-02d064677d30 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: bb8c372c-53a6-4aec-8c97-08c8af67c775] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:48.658356 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a13abd9d-162d-4487-9e39-02d064677d30 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:48.658852 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a13abd9d-162d-4487-9e39-02d064677d30 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:48.659639 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a13abd9d-162d-4487-9e39-02d064677d30 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:48.660080 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a13abd9d-162d-4487-9e39-02d064677d30 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:48.794309 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-a13abd9d-162d-4487-9e39-02d064677d30 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:48.801604 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a13abd9d-162d-4487-9e39-02d064677d30 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775" status: 200 len: 1266 microversion: 2.1 time: 0.154661 Feb 04 18:15:48.802173 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 629/1265] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:48 2022] GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:15:49.255332 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-404b8a26-5d8f-4127-8380-7cec30c74500 req-88315ce6-9004-40e9-8fea-a8728c2500e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8c372c-53a6-4aec-8c97-08c8af67c775", "name": "network-vif-plugged", "status": "completed", "tag": "98179b91-ea4a-4986-9a47-3e8973f618d3"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:15:49.257010 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:15:49.257010 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:15:49.267673 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-404b8a26-5d8f-4127-8380-7cec30c74500 req-88315ce6-9004-40e9-8fea-a8728c2500e3 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:49.267976 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-404b8a26-5d8f-4127-8380-7cec30c74500 req-88315ce6-9004-40e9-8fea-a8728c2500e3 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:49.279846 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-404b8a26-5d8f-4127-8380-7cec30c74500 req-88315ce6-9004-40e9-8fea-a8728c2500e3 service nova] Creating event network-vif-plugged:98179b91-ea4a-4986-9a47-3e8973f618d3 for instance bb8c372c-53a6-4aec-8c97-08c8af67c775 on hv-cinder-82276 Feb 04 18:15:49.286985 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-404b8a26-5d8f-4127-8380-7cec30c74500 req-88315ce6-9004-40e9-8fea-a8728c2500e3 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033828 Feb 04 18:15:49.286985 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 637/1266] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:15:49.818406 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a0ef37cc-5c69-4eb5-a20d-063ca1fc83dd tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:49.819044 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-a0ef37cc-5c69-4eb5-a20d-063ca1fc83dd tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: bb8c372c-53a6-4aec-8c97-08c8af67c775] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:49.824848 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a0ef37cc-5c69-4eb5-a20d-063ca1fc83dd tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:49.825295 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a0ef37cc-5c69-4eb5-a20d-063ca1fc83dd tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:49.826094 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a0ef37cc-5c69-4eb5-a20d-063ca1fc83dd tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:49.827249 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a0ef37cc-5c69-4eb5-a20d-063ca1fc83dd tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:49.975597 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-a0ef37cc-5c69-4eb5-a20d-063ca1fc83dd tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:49.983029 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a0ef37cc-5c69-4eb5-a20d-063ca1fc83dd tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775" status: 200 len: 1266 microversion: 2.1 time: 0.168421 Feb 04 18:15:49.984098 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 630/1267] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:49 2022] GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:15:51.000729 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-202dc70a-7dc1-4939-87f8-bdd7c9881f78 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:51.001415 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-202dc70a-7dc1-4939-87f8-bdd7c9881f78 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: bb8c372c-53a6-4aec-8c97-08c8af67c775] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:51.007523 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-202dc70a-7dc1-4939-87f8-bdd7c9881f78 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:51.007973 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-202dc70a-7dc1-4939-87f8-bdd7c9881f78 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:51.008748 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-202dc70a-7dc1-4939-87f8-bdd7c9881f78 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:51.009189 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-202dc70a-7dc1-4939-87f8-bdd7c9881f78 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:51.156784 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-202dc70a-7dc1-4939-87f8-bdd7c9881f78 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:51.164379 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-202dc70a-7dc1-4939-87f8-bdd7c9881f78 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775" status: 200 len: 1266 microversion: 2.1 time: 0.168016 Feb 04 18:15:51.164975 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 638/1268] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:50 2022] GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:15:52.180885 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c9c9d6bc-8d55-42fa-be45-101e51378040 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:52.187038 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c9c9d6bc-8d55-42fa-be45-101e51378040 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: bb8c372c-53a6-4aec-8c97-08c8af67c775] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:52.188340 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c9c9d6bc-8d55-42fa-be45-101e51378040 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:52.188794 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c9c9d6bc-8d55-42fa-be45-101e51378040 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:52.189668 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c9c9d6bc-8d55-42fa-be45-101e51378040 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:52.190104 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c9c9d6bc-8d55-42fa-be45-101e51378040 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:52.323148 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c9c9d6bc-8d55-42fa-be45-101e51378040 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:52.330533 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c9c9d6bc-8d55-42fa-be45-101e51378040 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775" status: 200 len: 1453 microversion: 2.1 time: 0.153308 Feb 04 18:15:52.331098 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 631/1269] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:52 2022] GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:15:52.348382 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-29f4678e-9d1c-442b-a427-ce4e115696c7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:15:52.348994 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-29f4678e-9d1c-442b-a427-ce4e115696c7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: bb8c372c-53a6-4aec-8c97-08c8af67c775] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:15:52.355301 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-29f4678e-9d1c-442b-a427-ce4e115696c7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:52.355761 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-29f4678e-9d1c-442b-a427-ce4e115696c7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:52.356536 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-29f4678e-9d1c-442b-a427-ce4e115696c7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:52.356977 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-29f4678e-9d1c-442b-a427-ce4e115696c7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:52.495510 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-29f4678e-9d1c-442b-a427-ce4e115696c7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:15:52.502766 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-29f4678e-9d1c-442b-a427-ce4e115696c7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775" status: 200 len: 1453 microversion: 2.1 time: 0.158043 Feb 04 18:15:52.503517 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 639/1270] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:15:52 2022] GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:15:54.887434 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-0b8bc9cc-5885-4791-85e1-4d2f3da5beba req-412c6cff-5e57-4d1e-804f-a0c687783f9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb8c372c-53a6-4aec-8c97-08c8af67c775", "tag": "98179b91-ea4a-4986-9a47-3e8973f618d3"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:15:54.889005 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:15:54.889005 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:15:54.896208 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-0b8bc9cc-5885-4791-85e1-4d2f3da5beba req-412c6cff-5e57-4d1e-804f-a0c687783f9f service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:15:54.896653 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-0b8bc9cc-5885-4791-85e1-4d2f3da5beba req-412c6cff-5e57-4d1e-804f-a0c687783f9f service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:15:54.909599 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-0b8bc9cc-5885-4791-85e1-4d2f3da5beba req-412c6cff-5e57-4d1e-804f-a0c687783f9f service nova] Creating event network-changed:98179b91-ea4a-4986-9a47-3e8973f618d3 for instance bb8c372c-53a6-4aec-8c97-08c8af67c775 on hv-cinder-82276 Feb 04 18:15:54.915049 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-0b8bc9cc-5885-4791-85e1-4d2f3da5beba req-412c6cff-5e57-4d1e-804f-a0c687783f9f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146954 Feb 04 18:15:54.915861 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 632/1271] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:16:33.054005 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-d7367c85-7886-431a-a1ac-34f7be47b9ae tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2102542864", "imageRef": "b0fb57f5-967d-4692-94f3-accee37910c3", "flavorRef": "452"}} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:16:33.102995 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.network.neutron [None req-d7367c85-7886-431a-a1ac-34f7be47b9ae tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] validate_networks() for None {{(pid=123566) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 04 18:16:33.383490 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-d7367c85-7886-431a-a1ac-34f7be47b9ae tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Flavor limits 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 04 18:16:33.383917 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-d7367c85-7886-431a-a1ac-34f7be47b9ae tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Image limits 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 04 18:16:33.384394 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-d7367c85-7886-431a-a1ac-34f7be47b9ae tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Flavor pref 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 04 18:16:33.384805 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-d7367c85-7886-431a-a1ac-34f7be47b9ae tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Image pref 0:0:0 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 04 18:16:33.385220 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.virt.hardware [None req-d7367c85-7886-431a-a1ac-34f7be47b9ae tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 04 18:16:33.394125 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d7367c85-7886-431a-a1ac-34f7be47b9ae tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:33.394623 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d7367c85-7886-431a-a1ac-34f7be47b9ae tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:33.395458 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d7367c85-7886-431a-a1ac-34f7be47b9ae tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:33.395893 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d7367c85-7886-431a-a1ac-34f7be47b9ae tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:33.412489 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-d7367c85-7886-431a-a1ac-34f7be47b9ae tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Getting quotas for project e8f50031c67c4202844e2e9176baa69a. Resources: {'cores', 'ram', 'instances'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:16:33.416412 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.quota [None req-d7367c85-7886-431a-a1ac-34f7be47b9ae tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Getting quotas for user 4d0d091deeb34dcb8cf1ea6632f62ef7 and project e8f50031c67c4202844e2e9176baa69a. Resources: {'cores', 'ram', 'instances'} {{(pid=123566) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:16:33.427565 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-d7367c85-7886-431a-a1ac-34f7be47b9ae tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Going to run 1 instances... {{(pid=123566) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 04 18:16:33.429858 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-d7367c85-7886-431a-a1ac-34f7be47b9ae tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] [instance: f47cbf52-d9e5-4048-a420-356a443f70ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b0fb57f5-967d-4692-94f3-accee37910c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 04 18:16:33.603064 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-d7367c85-7886-431a-a1ac-34f7be47b9ae tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552619 Feb 04 18:16:33.603818 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 640/1272] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Feb 4 18:16:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 04 18:16:33.615427 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-0ba4951b-d27a-4a4c-966b-c2a900236347 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:16:33.621380 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-0ba4951b-d27a-4a4c-966b-c2a900236347 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] [instance: f47cbf52-d9e5-4048-a420-356a443f70ff] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:16:33.671335 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-0ba4951b-d27a-4a4c-966b-c2a900236347 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0d091deeb34dcb8cf1ea6632f62ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f50031c67c4202844e2e9176baa69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:16:33.678176 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-0ba4951b-d27a-4a4c-966b-c2a900236347 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] 10.222.0.98 "GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff" status: 200 len: 1215 microversion: 2.1 time: 0.067397 Feb 04 18:16:33.678796 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 633/1273] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:16:33 2022] GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff => generated 1215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:16:34.696618 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-1d2d4dff-e0c4-4c1e-9db3-76859a852202 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:16:34.697182 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-1d2d4dff-e0c4-4c1e-9db3-76859a852202 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] [instance: f47cbf52-d9e5-4048-a420-356a443f70ff] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:16:34.752133 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-1d2d4dff-e0c4-4c1e-9db3-76859a852202 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0d091deeb34dcb8cf1ea6632f62ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f50031c67c4202844e2e9176baa69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:16:34.759149 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-1d2d4dff-e0c4-4c1e-9db3-76859a852202 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] 10.222.0.98 "GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff" status: 200 len: 1215 microversion: 2.1 time: 0.067322 Feb 04 18:16:34.764770 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 641/1274] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:16:34 2022] GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff => generated 1215 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:16:35.775988 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-7d57c45b-0171-4eb8-952d-5c9c57053a48 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:16:35.776607 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-7d57c45b-0171-4eb8-952d-5c9c57053a48 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] [instance: f47cbf52-d9e5-4048-a420-356a443f70ff] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:16:35.783666 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7d57c45b-0171-4eb8-952d-5c9c57053a48 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:35.784122 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7d57c45b-0171-4eb8-952d-5c9c57053a48 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:35.784897 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7d57c45b-0171-4eb8-952d-5c9c57053a48 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:35.785338 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-7d57c45b-0171-4eb8-952d-5c9c57053a48 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:35.845998 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-7d57c45b-0171-4eb8-952d-5c9c57053a48 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0d091deeb34dcb8cf1ea6632f62ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f50031c67c4202844e2e9176baa69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:16:35.853804 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-7d57c45b-0171-4eb8-952d-5c9c57053a48 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] 10.222.0.98 "GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff" status: 200 len: 1267 microversion: 2.1 time: 0.081381 Feb 04 18:16:35.857257 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 634/1275] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:16:35 2022] GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:16:36.871578 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-dd7580ad-e00f-49f7-ae3b-dc78177cbfcd tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:16:36.872188 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-dd7580ad-e00f-49f7-ae3b-dc78177cbfcd tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] [instance: f47cbf52-d9e5-4048-a420-356a443f70ff] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:16:36.878688 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dd7580ad-e00f-49f7-ae3b-dc78177cbfcd tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:36.879148 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dd7580ad-e00f-49f7-ae3b-dc78177cbfcd tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:36.879934 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dd7580ad-e00f-49f7-ae3b-dc78177cbfcd tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:36.880403 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-dd7580ad-e00f-49f7-ae3b-dc78177cbfcd tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:36.941012 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-dd7580ad-e00f-49f7-ae3b-dc78177cbfcd tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0d091deeb34dcb8cf1ea6632f62ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f50031c67c4202844e2e9176baa69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:16:36.948308 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-dd7580ad-e00f-49f7-ae3b-dc78177cbfcd tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] 10.222.0.98 "GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff" status: 200 len: 1273 microversion: 2.1 time: 0.080405 Feb 04 18:16:36.948873 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 642/1276] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:16:36 2022] GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff => generated 1273 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:16:37.964799 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-5fc45b29-6945-4229-be70-69440c6f5b0d tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:16:37.965406 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-5fc45b29-6945-4229-be70-69440c6f5b0d tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] [instance: f47cbf52-d9e5-4048-a420-356a443f70ff] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:16:37.972218 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5fc45b29-6945-4229-be70-69440c6f5b0d tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:37.972670 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5fc45b29-6945-4229-be70-69440c6f5b0d tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:37.973448 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5fc45b29-6945-4229-be70-69440c6f5b0d tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:37.973884 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5fc45b29-6945-4229-be70-69440c6f5b0d tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:38.061594 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-e47ad67c-389b-4c23-ba59-c6902529f396 req-7164c3f8-9c80-4b5b-b9dd-2279df97b801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f47cbf52-d9e5-4048-a420-356a443f70ff", "tag": "20a4e421-cdd3-4134-b77b-ed292894cf9e"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:16:38.063200 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:16:38.063200 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:16:38.071613 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-e47ad67c-389b-4c23-ba59-c6902529f396 req-7164c3f8-9c80-4b5b-b9dd-2279df97b801 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:38.072260 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-e47ad67c-389b-4c23-ba59-c6902529f396 req-7164c3f8-9c80-4b5b-b9dd-2279df97b801 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:38.084672 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-e47ad67c-389b-4c23-ba59-c6902529f396 req-7164c3f8-9c80-4b5b-b9dd-2279df97b801 service nova] Creating event network-changed:20a4e421-cdd3-4134-b77b-ed292894cf9e for instance f47cbf52-d9e5-4048-a420-356a443f70ff on hv-cinder-82276 Feb 04 18:16:38.092464 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-e47ad67c-389b-4c23-ba59-c6902529f396 req-7164c3f8-9c80-4b5b-b9dd-2279df97b801 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034058 Feb 04 18:16:38.093142 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 643/1277] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:16:38.120317 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5fc45b29-6945-4229-be70-69440c6f5b0d tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0d091deeb34dcb8cf1ea6632f62ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f50031c67c4202844e2e9176baa69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:16:38.129709 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-5fc45b29-6945-4229-be70-69440c6f5b0d tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] 10.222.0.98 "GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff" status: 200 len: 1315 microversion: 2.1 time: 0.168411 Feb 04 18:16:38.130270 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 635/1278] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:16:37 2022] GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:16:39.148073 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-a68c601a-c39f-4d70-8a13-41091c810b91 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:16:39.148784 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-a68c601a-c39f-4d70-8a13-41091c810b91 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] [instance: f47cbf52-d9e5-4048-a420-356a443f70ff] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:16:39.155387 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a68c601a-c39f-4d70-8a13-41091c810b91 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:39.158951 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a68c601a-c39f-4d70-8a13-41091c810b91 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:39.158951 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a68c601a-c39f-4d70-8a13-41091c810b91 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:39.158951 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a68c601a-c39f-4d70-8a13-41091c810b91 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:39.291694 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-a68c601a-c39f-4d70-8a13-41091c810b91 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0d091deeb34dcb8cf1ea6632f62ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f50031c67c4202844e2e9176baa69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:16:39.299524 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-a68c601a-c39f-4d70-8a13-41091c810b91 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] 10.222.0.98 "GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff" status: 200 len: 1315 microversion: 2.1 time: 0.155990 Feb 04 18:16:39.300082 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 644/1279] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:16:39 2022] GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:16:40.316237 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c724ffd9-67b7-4c6d-b96f-9e0049acffbc tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:16:40.316849 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c724ffd9-67b7-4c6d-b96f-9e0049acffbc tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] [instance: f47cbf52-d9e5-4048-a420-356a443f70ff] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:16:40.323190 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c724ffd9-67b7-4c6d-b96f-9e0049acffbc tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:40.323644 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c724ffd9-67b7-4c6d-b96f-9e0049acffbc tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:40.324415 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c724ffd9-67b7-4c6d-b96f-9e0049acffbc tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:40.324852 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c724ffd9-67b7-4c6d-b96f-9e0049acffbc tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:40.460645 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c724ffd9-67b7-4c6d-b96f-9e0049acffbc tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0d091deeb34dcb8cf1ea6632f62ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f50031c67c4202844e2e9176baa69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:16:40.468333 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c724ffd9-67b7-4c6d-b96f-9e0049acffbc tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] 10.222.0.98 "GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff" status: 200 len: 1315 microversion: 2.1 time: 0.155787 Feb 04 18:16:40.468903 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 636/1280] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:16:40 2022] GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:16:41.485765 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-a42145ec-eea6-4279-8dc3-a3977ef893dc tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:16:41.486380 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-a42145ec-eea6-4279-8dc3-a3977ef893dc tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] [instance: f47cbf52-d9e5-4048-a420-356a443f70ff] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:16:41.492730 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a42145ec-eea6-4279-8dc3-a3977ef893dc tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:41.493184 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a42145ec-eea6-4279-8dc3-a3977ef893dc tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:41.493958 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a42145ec-eea6-4279-8dc3-a3977ef893dc tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:41.494393 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a42145ec-eea6-4279-8dc3-a3977ef893dc tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:41.627959 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-a42145ec-eea6-4279-8dc3-a3977ef893dc tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0d091deeb34dcb8cf1ea6632f62ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f50031c67c4202844e2e9176baa69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:16:41.635348 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-a42145ec-eea6-4279-8dc3-a3977ef893dc tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] 10.222.0.98 "GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff" status: 200 len: 1315 microversion: 2.1 time: 0.154072 Feb 04 18:16:41.635924 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 645/1281] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:16:41 2022] GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:16:42.652055 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-c9c2491c-eb6c-4c9a-9133-0a9d139adf1f tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:16:42.652674 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-c9c2491c-eb6c-4c9a-9133-0a9d139adf1f tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] [instance: f47cbf52-d9e5-4048-a420-356a443f70ff] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:16:42.658990 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c9c2491c-eb6c-4c9a-9133-0a9d139adf1f tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:42.659456 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c9c2491c-eb6c-4c9a-9133-0a9d139adf1f tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:42.660227 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c9c2491c-eb6c-4c9a-9133-0a9d139adf1f tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:42.660671 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-c9c2491c-eb6c-4c9a-9133-0a9d139adf1f tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:42.790219 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-c9c2491c-eb6c-4c9a-9133-0a9d139adf1f tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0d091deeb34dcb8cf1ea6632f62ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f50031c67c4202844e2e9176baa69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:16:42.798176 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-c9c2491c-eb6c-4c9a-9133-0a9d139adf1f tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] 10.222.0.98 "GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff" status: 200 len: 1315 microversion: 2.1 time: 0.149806 Feb 04 18:16:42.798788 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 637/1282] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:16:42 2022] GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:16:43.815672 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-3df7229e-97b1-4b1b-845d-80fe25b6b1d5 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:16:43.816291 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-3df7229e-97b1-4b1b-845d-80fe25b6b1d5 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] [instance: f47cbf52-d9e5-4048-a420-356a443f70ff] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:16:43.822527 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3df7229e-97b1-4b1b-845d-80fe25b6b1d5 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:43.822975 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3df7229e-97b1-4b1b-845d-80fe25b6b1d5 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:43.823745 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3df7229e-97b1-4b1b-845d-80fe25b6b1d5 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:43.824183 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-3df7229e-97b1-4b1b-845d-80fe25b6b1d5 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:43.954955 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-3df7229e-97b1-4b1b-845d-80fe25b6b1d5 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0d091deeb34dcb8cf1ea6632f62ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f50031c67c4202844e2e9176baa69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:16:43.962334 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-3df7229e-97b1-4b1b-845d-80fe25b6b1d5 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] 10.222.0.98 "GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff" status: 200 len: 1315 microversion: 2.1 time: 0.150361 Feb 04 18:16:43.962954 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 646/1283] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:16:43 2022] GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:16:44.978964 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-193f24f4-f9c5-40ca-8f49-f106426f9fa7 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:16:44.980486 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-193f24f4-f9c5-40ca-8f49-f106426f9fa7 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] [instance: f47cbf52-d9e5-4048-a420-356a443f70ff] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:16:44.986626 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-193f24f4-f9c5-40ca-8f49-f106426f9fa7 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:44.987082 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-193f24f4-f9c5-40ca-8f49-f106426f9fa7 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:44.987858 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-193f24f4-f9c5-40ca-8f49-f106426f9fa7 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:44.988306 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-193f24f4-f9c5-40ca-8f49-f106426f9fa7 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:45.124378 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-193f24f4-f9c5-40ca-8f49-f106426f9fa7 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0d091deeb34dcb8cf1ea6632f62ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f50031c67c4202844e2e9176baa69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:16:45.132649 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-193f24f4-f9c5-40ca-8f49-f106426f9fa7 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] 10.222.0.98 "GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff" status: 200 len: 1315 microversion: 2.1 time: 0.157454 Feb 04 18:16:45.134485 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 638/1284] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:16:44 2022] GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:16:45.632872 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-16c737f6-4989-4892-8dff-2e693114312c req-2d2b89a6-eb80-4042-9f8f-435a5aee857a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47cbf52-d9e5-4048-a420-356a443f70ff", "name": "network-vif-plugged", "status": "completed", "tag": "20a4e421-cdd3-4134-b77b-ed292894cf9e"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:16:45.634406 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:16:45.634406 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:16:45.641840 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-16c737f6-4989-4892-8dff-2e693114312c req-2d2b89a6-eb80-4042-9f8f-435a5aee857a service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:45.642282 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-16c737f6-4989-4892-8dff-2e693114312c req-2d2b89a6-eb80-4042-9f8f-435a5aee857a service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:45.653369 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-16c737f6-4989-4892-8dff-2e693114312c req-2d2b89a6-eb80-4042-9f8f-435a5aee857a service nova] Creating event network-vif-plugged:20a4e421-cdd3-4134-b77b-ed292894cf9e for instance f47cbf52-d9e5-4048-a420-356a443f70ff on hv-cinder-82276 Feb 04 18:16:45.658394 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-16c737f6-4989-4892-8dff-2e693114312c req-2d2b89a6-eb80-4042-9f8f-435a5aee857a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028982 Feb 04 18:16:45.659024 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 647/1285] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:16:46.149675 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-876faf11-b993-4b12-b491-93a47a8faf61 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:16:46.150285 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-876faf11-b993-4b12-b491-93a47a8faf61 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] [instance: f47cbf52-d9e5-4048-a420-356a443f70ff] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:16:46.156650 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-876faf11-b993-4b12-b491-93a47a8faf61 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:46.157088 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-876faf11-b993-4b12-b491-93a47a8faf61 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:46.157851 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-876faf11-b993-4b12-b491-93a47a8faf61 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:46.158278 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-876faf11-b993-4b12-b491-93a47a8faf61 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:46.289474 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-876faf11-b993-4b12-b491-93a47a8faf61 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0d091deeb34dcb8cf1ea6632f62ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f50031c67c4202844e2e9176baa69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:16:46.297198 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-876faf11-b993-4b12-b491-93a47a8faf61 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] 10.222.0.98 "GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff" status: 200 len: 1315 microversion: 2.1 time: 0.151264 Feb 04 18:16:46.297763 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 639/1286] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:16:46 2022] GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:16:47.315226 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-9e54e64b-0235-4172-a602-bf74a554df62 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:16:47.326676 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-9e54e64b-0235-4172-a602-bf74a554df62 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] [instance: f47cbf52-d9e5-4048-a420-356a443f70ff] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:16:47.326676 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9e54e64b-0235-4172-a602-bf74a554df62 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:47.326676 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9e54e64b-0235-4172-a602-bf74a554df62 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:47.326676 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9e54e64b-0235-4172-a602-bf74a554df62 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:47.327116 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9e54e64b-0235-4172-a602-bf74a554df62 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:47.458820 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-9e54e64b-0235-4172-a602-bf74a554df62 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0d091deeb34dcb8cf1ea6632f62ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f50031c67c4202844e2e9176baa69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:16:47.466454 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-9e54e64b-0235-4172-a602-bf74a554df62 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] 10.222.0.98 "GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff" status: 200 len: 1315 microversion: 2.1 time: 0.155195 Feb 04 18:16:47.467011 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 648/1287] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:16:47 2022] GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:16:48.484037 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-a5a06893-12f8-4532-909d-b7898e75c735 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:16:48.484649 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-a5a06893-12f8-4532-909d-b7898e75c735 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] [instance: f47cbf52-d9e5-4048-a420-356a443f70ff] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:16:48.491132 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a5a06893-12f8-4532-909d-b7898e75c735 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:48.491536 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a5a06893-12f8-4532-909d-b7898e75c735 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:48.492318 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a5a06893-12f8-4532-909d-b7898e75c735 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:48.492788 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-a5a06893-12f8-4532-909d-b7898e75c735 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:48.625771 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-a5a06893-12f8-4532-909d-b7898e75c735 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0d091deeb34dcb8cf1ea6632f62ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f50031c67c4202844e2e9176baa69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:16:48.633557 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-a5a06893-12f8-4532-909d-b7898e75c735 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] 10.222.0.98 "GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff" status: 200 len: 1465 microversion: 2.1 time: 0.154037 Feb 04 18:16:48.634118 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 640/1288] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:16:48 2022] GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff => generated 1465 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:16:48.671905 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-8a0944a3-f324-465a-8313-d65bb0b15c41 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:16:48.672393 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-8a0944a3-f324-465a-8313-d65bb0b15c41 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] [instance: f47cbf52-d9e5-4048-a420-356a443f70ff] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:16:48.678223 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8a0944a3-f324-465a-8313-d65bb0b15c41 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:48.678718 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8a0944a3-f324-465a-8313-d65bb0b15c41 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:48.679492 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8a0944a3-f324-465a-8313-d65bb0b15c41 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:48.679936 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8a0944a3-f324-465a-8313-d65bb0b15c41 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:48.706144 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-8a0944a3-f324-465a-8313-d65bb0b15c41 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] [instance: f47cbf52-d9e5-4048-a420-356a443f70ff] Going to try to terminate instance {{(pid=123566) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 04 18:16:49.020798 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-8a0944a3-f324-465a-8313-d65bb0b15c41 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] 10.222.0.98 "DELETE /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff" status: 204 len: 0 microversion: 2.1 time: 0.352509 Feb 04 18:16:49.021406 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 649/1289] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Feb 4 18:16:48 2022] DELETE /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 04 18:16:49.029328 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-333b28f6-a55e-435a-9e38-a7b13c035acd tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:16:49.029996 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-333b28f6-a55e-435a-9e38-a7b13c035acd tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] [instance: f47cbf52-d9e5-4048-a420-356a443f70ff] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:16:49.036622 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-333b28f6-a55e-435a-9e38-a7b13c035acd tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:49.037075 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-333b28f6-a55e-435a-9e38-a7b13c035acd tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:49.037846 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-333b28f6-a55e-435a-9e38-a7b13c035acd tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:49.038289 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-333b28f6-a55e-435a-9e38-a7b13c035acd tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:49.174547 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-333b28f6-a55e-435a-9e38-a7b13c035acd tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0d091deeb34dcb8cf1ea6632f62ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f50031c67c4202844e2e9176baa69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:16:49.182004 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-333b28f6-a55e-435a-9e38-a7b13c035acd tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] 10.222.0.98 "GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff" status: 200 len: 1471 microversion: 2.1 time: 0.156336 Feb 04 18:16:49.182632 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 641/1290] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:16:49 2022] GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:16:50.198901 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-38bf6913-a58f-4846-a7b7-f93892781c71 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:16:50.199606 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-38bf6913-a58f-4846-a7b7-f93892781c71 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] [instance: f47cbf52-d9e5-4048-a420-356a443f70ff] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:16:50.206491 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-38bf6913-a58f-4846-a7b7-f93892781c71 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:50.206949 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-38bf6913-a58f-4846-a7b7-f93892781c71 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:50.207721 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-38bf6913-a58f-4846-a7b7-f93892781c71 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:50.208159 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-38bf6913-a58f-4846-a7b7-f93892781c71 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:50.342727 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-38bf6913-a58f-4846-a7b7-f93892781c71 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0d091deeb34dcb8cf1ea6632f62ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f50031c67c4202844e2e9176baa69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:16:50.350405 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-38bf6913-a58f-4846-a7b7-f93892781c71 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] 10.222.0.98 "GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff" status: 200 len: 1471 microversion: 2.1 time: 0.155550 Feb 04 18:16:50.351157 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 650/1291] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:16:50 2022] GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:16:51.368464 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-902e5685-f0e0-47ef-af6c-cedb1894b0e5 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:16:51.370325 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-902e5685-f0e0-47ef-af6c-cedb1894b0e5 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] [instance: f47cbf52-d9e5-4048-a420-356a443f70ff] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:16:51.410906 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-902e5685-f0e0-47ef-af6c-cedb1894b0e5 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:51.410906 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-902e5685-f0e0-47ef-af6c-cedb1894b0e5 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:51.410906 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-902e5685-f0e0-47ef-af6c-cedb1894b0e5 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:51.410906 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-902e5685-f0e0-47ef-af6c-cedb1894b0e5 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:51.411744 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-7f4b253f-cc9d-4e3b-bc67-96214e38f8de req-1bb35d0c-bd76-4d8a-b891-09ea858c8a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47cbf52-d9e5-4048-a420-356a443f70ff", "name": "network-vif-deleted", "tag": "20a4e421-cdd3-4134-b77b-ed292894cf9e"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:16:51.411744 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:16:51.411744 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:16:51.418577 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-7f4b253f-cc9d-4e3b-bc67-96214e38f8de req-1bb35d0c-bd76-4d8a-b891-09ea858c8a6e service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:51.420651 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-7f4b253f-cc9d-4e3b-bc67-96214e38f8de req-1bb35d0c-bd76-4d8a-b891-09ea858c8a6e service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:51.432997 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-7f4b253f-cc9d-4e3b-bc67-96214e38f8de req-1bb35d0c-bd76-4d8a-b891-09ea858c8a6e service nova] Creating event network-vif-deleted:20a4e421-cdd3-4134-b77b-ed292894cf9e for instance f47cbf52-d9e5-4048-a420-356a443f70ff on hv-cinder-82276 Feb 04 18:16:51.438537 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-7f4b253f-cc9d-4e3b-bc67-96214e38f8de req-1bb35d0c-bd76-4d8a-b891-09ea858c8a6e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039129 Feb 04 18:16:51.442528 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 651/1292] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:16:51.460396 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-902e5685-f0e0-47ef-af6c-cedb1894b0e5 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0d091deeb34dcb8cf1ea6632f62ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f50031c67c4202844e2e9176baa69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:16:51.467554 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-902e5685-f0e0-47ef-af6c-cedb1894b0e5 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] 10.222.0.98 "GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff" status: 200 len: 1429 microversion: 2.1 time: 0.102798 Feb 04 18:16:51.467846 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 642/1293] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:16:51 2022] GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff => generated 1429 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:16:52.486029 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b547726f-3f9b-43f5-94ee-1c2e2d0edad8 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:16:52.486785 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-b547726f-3f9b-43f5-94ee-1c2e2d0edad8 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] [instance: f47cbf52-d9e5-4048-a420-356a443f70ff] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:16:52.492922 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b547726f-3f9b-43f5-94ee-1c2e2d0edad8 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:52.493376 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b547726f-3f9b-43f5-94ee-1c2e2d0edad8 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:52.494158 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b547726f-3f9b-43f5-94ee-1c2e2d0edad8 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:16:52.494633 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-b547726f-3f9b-43f5-94ee-1c2e2d0edad8 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:16:52.508921 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-b547726f-3f9b-43f5-94ee-1c2e2d0edad8 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] HTTP exception thrown: Instance f47cbf52-d9e5-4048-a420-356a443f70ff could not be found. Feb 04 18:16:52.509560 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-b547726f-3f9b-43f5-94ee-1c2e2d0edad8 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] Returning 404 to user: Instance f47cbf52-d9e5-4048-a420-356a443f70ff could not be found. {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:16:52.510436 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-b547726f-3f9b-43f5-94ee-1c2e2d0edad8 tempest-VolumesNegativeTest-277278604 tempest-VolumesNegativeTest-277278604-project] 10.222.0.98 "GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff" status: 404 len: 111 microversion: 2.1 time: 0.029693 Feb 04 18:16:52.510988 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 652/1294] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:16:52 2022] GET /compute/v2.1/servers/f47cbf52-d9e5-4048-a420-356a443f70ff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 04 18:17:33.584254 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 04 18:17:33.585063 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: Fri Feb 4 18:17:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 04 18:17:54.361808 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-2129d455-00e4-4051-b5a0-7fa8510dd197 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1695274093", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1196483484", "security_groups": [{"name": "tempest-secgroup-smoke-453985264"}], "block_device_mapping_v2": [{"uuid": "3c71006c-7685-40e6-b26b-822abfe69fdc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c2f9ed8d-fda8-42c7-8ea1-cd07bcb8b632"}]}} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:17:54.468333 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.network.neutron [None req-2129d455-00e4-4051-b5a0-7fa8510dd197 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] validate_networks() for [('c2f9ed8d-fda8-42c7-8ea1-cd07bcb8b632', None, None, None, None, None)] {{(pid=123567) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 04 18:17:54.921169 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-2129d455-00e4-4051-b5a0-7fa8510dd197 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Flavor limits 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 04 18:17:54.921593 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-2129d455-00e4-4051-b5a0-7fa8510dd197 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Image limits 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 04 18:17:54.922063 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-2129d455-00e4-4051-b5a0-7fa8510dd197 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Flavor pref 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 04 18:17:54.922511 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-2129d455-00e4-4051-b5a0-7fa8510dd197 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Image pref 0:0:0 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 04 18:17:54.922923 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.virt.hardware [None req-2129d455-00e4-4051-b5a0-7fa8510dd197 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 04 18:17:54.931633 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2129d455-00e4-4051-b5a0-7fa8510dd197 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:17:54.932059 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2129d455-00e4-4051-b5a0-7fa8510dd197 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:17:54.932858 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2129d455-00e4-4051-b5a0-7fa8510dd197 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:17:54.933291 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-2129d455-00e4-4051-b5a0-7fa8510dd197 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:17:54.949573 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-2129d455-00e4-4051-b5a0-7fa8510dd197 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Getting quotas for project 7f2ff016321049ceb841522b8fe2c27a. Resources: {'cores', 'ram', 'instances'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 04 18:17:54.953910 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.quota [None req-2129d455-00e4-4051-b5a0-7fa8510dd197 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Getting quotas for user 508cd118fbdd432491f2e778e789473d and project 7f2ff016321049ceb841522b8fe2c27a. Resources: {'cores', 'ram', 'instances'} {{(pid=123567) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 04 18:17:55.006706 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-2129d455-00e4-4051-b5a0-7fa8510dd197 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Going to run 1 instances... {{(pid=123567) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 04 18:17:55.008977 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-2129d455-00e4-4051-b5a0-7fa8510dd197 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: 89345003-9b16-4b85-9a72-5f1b9d9e0d74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3c71006c-7685-40e6-b26b-822abfe69fdc',volume_size=None,volume_type=None)] {{(pid=123567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 04 18:17:55.500217 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-2129d455-00e4-4051-b5a0-7fa8510dd197 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.143650 Feb 04 18:17:55.505740 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 643/1295] 10.222.0.98 () {60 vars in 1146 bytes} [Fri Feb 4 18:17:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 04 18:17:55.511487 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-0b1bb65c-f042-45cf-8866-5bfc86d9a8ad tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:17:55.512109 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-0b1bb65c-f042-45cf-8866-5bfc86d9a8ad tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: 89345003-9b16-4b85-9a72-5f1b9d9e0d74] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:17:55.564629 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-0b1bb65c-f042-45cf-8866-5bfc86d9a8ad tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:17:55.571084 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-0b1bb65c-f042-45cf-8866-5bfc86d9a8ad tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74" status: 200 len: 1095 microversion: 2.1 time: 0.064023 Feb 04 18:17:55.571648 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 653/1296] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:17:55 2022] GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74 => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:17:56.587888 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-5cf5bb0c-de7c-415d-83fc-603378af9fb7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:17:56.588479 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-5cf5bb0c-de7c-415d-83fc-603378af9fb7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: 89345003-9b16-4b85-9a72-5f1b9d9e0d74] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:17:56.594505 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5cf5bb0c-de7c-415d-83fc-603378af9fb7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:17:56.594953 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5cf5bb0c-de7c-415d-83fc-603378af9fb7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:17:56.595715 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5cf5bb0c-de7c-415d-83fc-603378af9fb7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:17:56.596147 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5cf5bb0c-de7c-415d-83fc-603378af9fb7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:17:56.655278 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5cf5bb0c-de7c-415d-83fc-603378af9fb7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:17:56.662661 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-5cf5bb0c-de7c-415d-83fc-603378af9fb7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74" status: 200 len: 1145 microversion: 2.1 time: 0.078948 Feb 04 18:17:56.663226 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 644/1297] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:17:56 2022] GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:17:57.679987 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-d776daaf-35b5-49f1-863f-04255d8fb519 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:17:57.680595 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-d776daaf-35b5-49f1-863f-04255d8fb519 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: 89345003-9b16-4b85-9a72-5f1b9d9e0d74] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:17:57.688440 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d776daaf-35b5-49f1-863f-04255d8fb519 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:17:57.688851 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d776daaf-35b5-49f1-863f-04255d8fb519 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:17:57.689671 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d776daaf-35b5-49f1-863f-04255d8fb519 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:17:57.690084 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-d776daaf-35b5-49f1-863f-04255d8fb519 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:17:57.750134 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-d776daaf-35b5-49f1-863f-04255d8fb519 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:17:57.757554 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-d776daaf-35b5-49f1-863f-04255d8fb519 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74" status: 200 len: 1201 microversion: 2.1 time: 0.081276 Feb 04 18:17:57.758255 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 654/1298] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:17:57 2022] GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74 => generated 1201 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:17:58.774885 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-00e0fbc2-2dc0-4e38-98ae-fdcd6507bfe0 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:17:58.775579 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-00e0fbc2-2dc0-4e38-98ae-fdcd6507bfe0 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: 89345003-9b16-4b85-9a72-5f1b9d9e0d74] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:17:58.786083 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-00e0fbc2-2dc0-4e38-98ae-fdcd6507bfe0 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:17:58.786083 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-00e0fbc2-2dc0-4e38-98ae-fdcd6507bfe0 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:17:58.786083 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-00e0fbc2-2dc0-4e38-98ae-fdcd6507bfe0 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:17:58.786083 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-00e0fbc2-2dc0-4e38-98ae-fdcd6507bfe0 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:17:58.928873 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-00e0fbc2-2dc0-4e38-98ae-fdcd6507bfe0 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:17:58.937923 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-00e0fbc2-2dc0-4e38-98ae-fdcd6507bfe0 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74" status: 200 len: 1278 microversion: 2.1 time: 0.166686 Feb 04 18:17:58.938907 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 645/1299] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:17:58 2022] GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:17:59.664417 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-520813c8-08aa-49c9-af82-4c715ce08fae req-3274fb7d-d11b-49e7-b6fe-211f3dd4311a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89345003-9b16-4b85-9a72-5f1b9d9e0d74", "tag": "f0303691-ee1c-4cbd-b2e6-c1386c0a4d63"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:17:59.669438 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:17:59.669438 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:17:59.677962 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-520813c8-08aa-49c9-af82-4c715ce08fae req-3274fb7d-d11b-49e7-b6fe-211f3dd4311a service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:17:59.678498 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-520813c8-08aa-49c9-af82-4c715ce08fae req-3274fb7d-d11b-49e7-b6fe-211f3dd4311a service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:17:59.690988 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-520813c8-08aa-49c9-af82-4c715ce08fae req-3274fb7d-d11b-49e7-b6fe-211f3dd4311a service nova] Creating event network-changed:f0303691-ee1c-4cbd-b2e6-c1386c0a4d63 for instance 89345003-9b16-4b85-9a72-5f1b9d9e0d74 on hv-cinder-82276 Feb 04 18:17:59.696424 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-520813c8-08aa-49c9-af82-4c715ce08fae req-3274fb7d-d11b-49e7-b6fe-211f3dd4311a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168626 Feb 04 18:17:59.696956 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 655/1300] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:17:59.955912 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-f9b78ab7-1a11-4b39-8850-ef4f1a2b3d1a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:17:59.956655 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-f9b78ab7-1a11-4b39-8850-ef4f1a2b3d1a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: 89345003-9b16-4b85-9a72-5f1b9d9e0d74] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:17:59.963557 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f9b78ab7-1a11-4b39-8850-ef4f1a2b3d1a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:17:59.964012 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f9b78ab7-1a11-4b39-8850-ef4f1a2b3d1a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:17:59.964812 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f9b78ab7-1a11-4b39-8850-ef4f1a2b3d1a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:17:59.965256 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-f9b78ab7-1a11-4b39-8850-ef4f1a2b3d1a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:00.114134 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-f9b78ab7-1a11-4b39-8850-ef4f1a2b3d1a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:18:00.121842 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-f9b78ab7-1a11-4b39-8850-ef4f1a2b3d1a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74" status: 200 len: 1266 microversion: 2.1 time: 0.169930 Feb 04 18:18:00.131383 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 646/1301] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:17:59 2022] GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:18:01.140261 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-38fb4bab-0808-456d-9ffd-6560e39c23b8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:18:01.140886 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-38fb4bab-0808-456d-9ffd-6560e39c23b8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: 89345003-9b16-4b85-9a72-5f1b9d9e0d74] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:18:01.147253 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-38fb4bab-0808-456d-9ffd-6560e39c23b8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:01.147745 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-38fb4bab-0808-456d-9ffd-6560e39c23b8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:01.148523 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-38fb4bab-0808-456d-9ffd-6560e39c23b8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:01.148960 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-38fb4bab-0808-456d-9ffd-6560e39c23b8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:01.283361 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-38fb4bab-0808-456d-9ffd-6560e39c23b8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:18:01.290637 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-38fb4bab-0808-456d-9ffd-6560e39c23b8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74" status: 200 len: 1266 microversion: 2.1 time: 0.155425 Feb 04 18:18:01.291196 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 656/1302] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:18:01 2022] GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:18:02.307488 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-566130e5-d2ee-457e-99e0-1c5480f38a58 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:18:02.308461 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-566130e5-d2ee-457e-99e0-1c5480f38a58 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: 89345003-9b16-4b85-9a72-5f1b9d9e0d74] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:18:02.314429 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-566130e5-d2ee-457e-99e0-1c5480f38a58 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:02.314892 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-566130e5-d2ee-457e-99e0-1c5480f38a58 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:02.315672 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-566130e5-d2ee-457e-99e0-1c5480f38a58 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:02.316105 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-566130e5-d2ee-457e-99e0-1c5480f38a58 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:02.451347 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-566130e5-d2ee-457e-99e0-1c5480f38a58 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:18:02.458739 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-566130e5-d2ee-457e-99e0-1c5480f38a58 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74" status: 200 len: 1266 microversion: 2.1 time: 0.154927 Feb 04 18:18:02.459318 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 647/1303] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:18:02 2022] GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:18:03.475979 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-f4be5442-520b-4bef-928b-58151286374c tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:18:03.476572 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-f4be5442-520b-4bef-928b-58151286374c tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: 89345003-9b16-4b85-9a72-5f1b9d9e0d74] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:18:03.484121 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f4be5442-520b-4bef-928b-58151286374c tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:03.484559 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f4be5442-520b-4bef-928b-58151286374c tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:03.485336 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f4be5442-520b-4bef-928b-58151286374c tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:03.485764 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-f4be5442-520b-4bef-928b-58151286374c tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:03.617789 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-f4be5442-520b-4bef-928b-58151286374c tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:18:03.625737 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-f4be5442-520b-4bef-928b-58151286374c tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74" status: 200 len: 1266 microversion: 2.1 time: 0.153460 Feb 04 18:18:03.626323 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 657/1304] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:18:03 2022] GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:18:04.642588 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-0f37973c-59aa-4898-8516-9264fb1eb349 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:18:04.643227 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-0f37973c-59aa-4898-8516-9264fb1eb349 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: 89345003-9b16-4b85-9a72-5f1b9d9e0d74] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:18:04.649598 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0f37973c-59aa-4898-8516-9264fb1eb349 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:04.650050 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0f37973c-59aa-4898-8516-9264fb1eb349 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:04.650878 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0f37973c-59aa-4898-8516-9264fb1eb349 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:04.651324 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0f37973c-59aa-4898-8516-9264fb1eb349 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:04.788450 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-0f37973c-59aa-4898-8516-9264fb1eb349 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:18:04.796429 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-0f37973c-59aa-4898-8516-9264fb1eb349 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74" status: 200 len: 1266 microversion: 2.1 time: 0.157746 Feb 04 18:18:04.797566 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 648/1305] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:18:04 2022] GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:18:05.813000 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-6967c525-2ed7-436e-92ed-bd6ad676358e tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:18:05.813642 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-6967c525-2ed7-436e-92ed-bd6ad676358e tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: 89345003-9b16-4b85-9a72-5f1b9d9e0d74] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:18:05.819836 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6967c525-2ed7-436e-92ed-bd6ad676358e tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:05.820283 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6967c525-2ed7-436e-92ed-bd6ad676358e tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:05.821049 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6967c525-2ed7-436e-92ed-bd6ad676358e tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:05.821491 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-6967c525-2ed7-436e-92ed-bd6ad676358e tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:05.952436 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-6967c525-2ed7-436e-92ed-bd6ad676358e tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:18:05.959770 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-6967c525-2ed7-436e-92ed-bd6ad676358e tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74" status: 200 len: 1266 microversion: 2.1 time: 0.150363 Feb 04 18:18:05.960347 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 658/1306] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:18:05 2022] GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:18:06.976299 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-1f27a557-667c-4a0a-b81c-b19f846b0b84 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:18:06.976901 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-1f27a557-667c-4a0a-b81c-b19f846b0b84 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: 89345003-9b16-4b85-9a72-5f1b9d9e0d74] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:18:06.984072 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1f27a557-667c-4a0a-b81c-b19f846b0b84 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:06.984516 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1f27a557-667c-4a0a-b81c-b19f846b0b84 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:06.985281 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1f27a557-667c-4a0a-b81c-b19f846b0b84 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:06.985716 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-1f27a557-667c-4a0a-b81c-b19f846b0b84 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:07.122814 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-1f27a557-667c-4a0a-b81c-b19f846b0b84 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:18:07.130027 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-1f27a557-667c-4a0a-b81c-b19f846b0b84 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74" status: 200 len: 1266 microversion: 2.1 time: 0.157454 Feb 04 18:18:07.130640 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 649/1307] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:18:06 2022] GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:18:08.146815 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-e862606a-7e39-45a3-9ecf-077619bf4ec5 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:18:08.147431 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-e862606a-7e39-45a3-9ecf-077619bf4ec5 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: 89345003-9b16-4b85-9a72-5f1b9d9e0d74] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:18:08.154475 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e862606a-7e39-45a3-9ecf-077619bf4ec5 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:08.154930 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e862606a-7e39-45a3-9ecf-077619bf4ec5 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:08.155702 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e862606a-7e39-45a3-9ecf-077619bf4ec5 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:08.156143 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-e862606a-7e39-45a3-9ecf-077619bf4ec5 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:08.286871 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-e862606a-7e39-45a3-9ecf-077619bf4ec5 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:18:08.294078 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-e862606a-7e39-45a3-9ecf-077619bf4ec5 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74" status: 200 len: 1266 microversion: 2.1 time: 0.151006 Feb 04 18:18:08.294679 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 659/1308] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:18:08 2022] GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:18:09.312425 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-5578f7c4-5d14-48d4-bf46-75c512577f9a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:18:09.313037 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-5578f7c4-5d14-48d4-bf46-75c512577f9a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: 89345003-9b16-4b85-9a72-5f1b9d9e0d74] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:18:09.319279 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5578f7c4-5d14-48d4-bf46-75c512577f9a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:09.319788 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5578f7c4-5d14-48d4-bf46-75c512577f9a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:09.320634 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5578f7c4-5d14-48d4-bf46-75c512577f9a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:09.321064 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5578f7c4-5d14-48d4-bf46-75c512577f9a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:09.457476 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5578f7c4-5d14-48d4-bf46-75c512577f9a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:18:09.464912 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-5578f7c4-5d14-48d4-bf46-75c512577f9a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74" status: 200 len: 1266 microversion: 2.1 time: 0.157117 Feb 04 18:18:09.466540 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 650/1309] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:18:09 2022] GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:18:10.482031 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-ff82208d-9b73-4ba5-b4a3-6b359ce757bc tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:18:10.482685 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-ff82208d-9b73-4ba5-b4a3-6b359ce757bc tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: 89345003-9b16-4b85-9a72-5f1b9d9e0d74] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:18:10.489136 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ff82208d-9b73-4ba5-b4a3-6b359ce757bc tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:10.489588 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ff82208d-9b73-4ba5-b4a3-6b359ce757bc tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:10.490402 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ff82208d-9b73-4ba5-b4a3-6b359ce757bc tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:10.490877 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-ff82208d-9b73-4ba5-b4a3-6b359ce757bc tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:10.625088 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-ff82208d-9b73-4ba5-b4a3-6b359ce757bc tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:18:10.632903 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-ff82208d-9b73-4ba5-b4a3-6b359ce757bc tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74" status: 200 len: 1266 microversion: 2.1 time: 0.154808 Feb 04 18:18:10.633673 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 660/1310] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:18:10 2022] GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:18:11.649518 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-36637655-5fb2-43e0-b281-3bc6f09ba702 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:18:11.650154 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-36637655-5fb2-43e0-b281-3bc6f09ba702 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: 89345003-9b16-4b85-9a72-5f1b9d9e0d74] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:18:11.657288 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-36637655-5fb2-43e0-b281-3bc6f09ba702 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:11.657758 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-36637655-5fb2-43e0-b281-3bc6f09ba702 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:11.658563 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-36637655-5fb2-43e0-b281-3bc6f09ba702 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:11.659005 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-36637655-5fb2-43e0-b281-3bc6f09ba702 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:11.789257 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-36637655-5fb2-43e0-b281-3bc6f09ba702 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:18:11.796682 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-36637655-5fb2-43e0-b281-3bc6f09ba702 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74" status: 200 len: 1266 microversion: 2.1 time: 0.150859 Feb 04 18:18:11.797249 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 651/1311] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:18:11 2022] GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:18:12.076910 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-26906e47-80a3-4abb-b2bf-3ea004ef7f13 req-246d8e4a-9fb0-4017-a642-ea3742960db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89345003-9b16-4b85-9a72-5f1b9d9e0d74", "name": "network-vif-plugged", "status": "completed", "tag": "f0303691-ee1c-4cbd-b2e6-c1386c0a4d63"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:18:12.078518 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:18:12.078518 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:18:12.085330 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-26906e47-80a3-4abb-b2bf-3ea004ef7f13 req-246d8e4a-9fb0-4017-a642-ea3742960db7 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:12.085778 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-26906e47-80a3-4abb-b2bf-3ea004ef7f13 req-246d8e4a-9fb0-4017-a642-ea3742960db7 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:12.096511 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-26906e47-80a3-4abb-b2bf-3ea004ef7f13 req-246d8e4a-9fb0-4017-a642-ea3742960db7 service nova] Creating event network-vif-plugged:f0303691-ee1c-4cbd-b2e6-c1386c0a4d63 for instance 89345003-9b16-4b85-9a72-5f1b9d9e0d74 on hv-cinder-82276 Feb 04 18:18:12.101633 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-26906e47-80a3-4abb-b2bf-3ea004ef7f13 req-246d8e4a-9fb0-4017-a642-ea3742960db7 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083534 Feb 04 18:18:12.105564 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 661/1312] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:18:12.813829 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-5cf4dcac-20de-4354-83d8-99508475d843 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:18:12.814481 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-5cf4dcac-20de-4354-83d8-99508475d843 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: 89345003-9b16-4b85-9a72-5f1b9d9e0d74] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:18:12.820911 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5cf4dcac-20de-4354-83d8-99508475d843 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:12.821366 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5cf4dcac-20de-4354-83d8-99508475d843 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:12.822144 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5cf4dcac-20de-4354-83d8-99508475d843 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:12.822626 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-5cf4dcac-20de-4354-83d8-99508475d843 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:12.962620 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-5cf4dcac-20de-4354-83d8-99508475d843 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:18:12.970306 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-5cf4dcac-20de-4354-83d8-99508475d843 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74" status: 200 len: 1266 microversion: 2.1 time: 0.160294 Feb 04 18:18:12.970934 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 652/1313] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:18:12 2022] GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:18:13.987986 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-eb2c9113-3b91-4735-b44d-23335c40da29 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:18:13.988693 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-eb2c9113-3b91-4735-b44d-23335c40da29 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: 89345003-9b16-4b85-9a72-5f1b9d9e0d74] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:18:13.994925 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-eb2c9113-3b91-4735-b44d-23335c40da29 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:13.995365 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-eb2c9113-3b91-4735-b44d-23335c40da29 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:13.996132 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-eb2c9113-3b91-4735-b44d-23335c40da29 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:13.996566 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-eb2c9113-3b91-4735-b44d-23335c40da29 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:14.129266 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-eb2c9113-3b91-4735-b44d-23335c40da29 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:18:14.138358 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-eb2c9113-3b91-4735-b44d-23335c40da29 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74" status: 200 len: 1266 microversion: 2.1 time: 0.154462 Feb 04 18:18:14.142339 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 662/1314] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:18:13 2022] GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:18:15.154980 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e8540a20-748f-4697-a94c-f048ad2855e7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:18:15.155593 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-e8540a20-748f-4697-a94c-f048ad2855e7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: 89345003-9b16-4b85-9a72-5f1b9d9e0d74] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:18:15.161813 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e8540a20-748f-4697-a94c-f048ad2855e7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:15.162256 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e8540a20-748f-4697-a94c-f048ad2855e7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:15.163066 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e8540a20-748f-4697-a94c-f048ad2855e7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:15.163506 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e8540a20-748f-4697-a94c-f048ad2855e7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:15.296546 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e8540a20-748f-4697-a94c-f048ad2855e7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:18:15.303864 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e8540a20-748f-4697-a94c-f048ad2855e7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74" status: 200 len: 1454 microversion: 2.1 time: 0.153150 Feb 04 18:18:15.304423 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 653/1315] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:18:15 2022] GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:18:15.319489 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-a6a04a00-c4f1-4260-be07-275b8fbd2dc4 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:18:15.320162 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-a6a04a00-c4f1-4260-be07-275b8fbd2dc4 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: 89345003-9b16-4b85-9a72-5f1b9d9e0d74] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:18:15.326339 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a6a04a00-c4f1-4260-be07-275b8fbd2dc4 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:15.326815 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a6a04a00-c4f1-4260-be07-275b8fbd2dc4 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:15.327577 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a6a04a00-c4f1-4260-be07-275b8fbd2dc4 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:15.328011 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-a6a04a00-c4f1-4260-be07-275b8fbd2dc4 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:15.462644 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-a6a04a00-c4f1-4260-be07-275b8fbd2dc4 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:18:15.470670 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-a6a04a00-c4f1-4260-be07-275b8fbd2dc4 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74" status: 200 len: 1454 microversion: 2.1 time: 0.154816 Feb 04 18:18:15.471241 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 663/1316] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:18:15 2022] GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:18:17.803108 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-40ac4d41-9531-442c-b421-f58ade52219a req-34d09df7-a333-4702-ac5a-612b4c6bd08e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89345003-9b16-4b85-9a72-5f1b9d9e0d74", "tag": "f0303691-ee1c-4cbd-b2e6-c1386c0a4d63"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:18:17.804862 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:18:17.804862 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:18:17.812353 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-40ac4d41-9531-442c-b421-f58ade52219a req-34d09df7-a333-4702-ac5a-612b4c6bd08e service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:18:17.812796 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-40ac4d41-9531-442c-b421-f58ade52219a req-34d09df7-a333-4702-ac5a-612b4c6bd08e service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:18:17.823780 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-40ac4d41-9531-442c-b421-f58ade52219a req-34d09df7-a333-4702-ac5a-612b4c6bd08e service nova] Creating event network-changed:f0303691-ee1c-4cbd-b2e6-c1386c0a4d63 for instance 89345003-9b16-4b85-9a72-5f1b9d9e0d74 on hv-cinder-82276 Feb 04 18:18:17.829341 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-40ac4d41-9531-442c-b421-f58ade52219a req-34d09df7-a333-4702-ac5a-612b4c6bd08e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029859 Feb 04 18:18:17.830145 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 654/1317] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:19:05.807872 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 04 18:19:05.808553 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: Fri Feb 4 18:19:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 04 18:19:47.884443 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 04 18:19:47.885069 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: Fri Feb 4 18:19:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 04 18:20:07.707366 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [21547354-8e01-493d-8955-3cf44af18d84] AMQP server on 10.222.0.98:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Feb 04 18:20:07.708279 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-9c139340-c7f3-440c-8cc6-a7eb4e6bc23f tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:20:07.709010 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-9c139340-c7f3-440c-8cc6-a7eb4e6bc23f tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: 89345003-9b16-4b85-9a72-5f1b9d9e0d74] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:20:07.712720 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-0ea3481e-2340-4775-a17f-ce1b491c8291 req-7755c853-2d6f-482a-9bc3-afd7f877b283 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89345003-9b16-4b85-9a72-5f1b9d9e0d74", "tag": "f0303691-ee1c-4cbd-b2e6-c1386c0a4d63"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:20:07.714251 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:20:07.714251 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:20:07.715398 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9c139340-c7f3-440c-8cc6-a7eb4e6bc23f tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:07.715922 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9c139340-c7f3-440c-8cc6-a7eb4e6bc23f tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:07.716774 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9c139340-c7f3-440c-8cc6-a7eb4e6bc23f tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:07.717302 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9c139340-c7f3-440c-8cc6-a7eb4e6bc23f tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:07.723375 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-0ea3481e-2340-4775-a17f-ce1b491c8291 req-7755c853-2d6f-482a-9bc3-afd7f877b283 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:07.723375 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-0ea3481e-2340-4775-a17f-ce1b491c8291 req-7755c853-2d6f-482a-9bc3-afd7f877b283 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:07.734133 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-0ea3481e-2340-4775-a17f-ce1b491c8291 req-7755c853-2d6f-482a-9bc3-afd7f877b283 service nova] Creating event network-changed:f0303691-ee1c-4cbd-b2e6-c1386c0a4d63 for instance 89345003-9b16-4b85-9a72-5f1b9d9e0d74 on hv-cinder-82276 Feb 04 18:20:07.740804 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-0ea3481e-2340-4775-a17f-ce1b491c8291 req-7755c853-2d6f-482a-9bc3-afd7f877b283 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035601 Feb 04 18:20:07.741495 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 655/1318] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 04 18:20:07.746203 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-9c139340-c7f3-440c-8cc6-a7eb4e6bc23f tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: 89345003-9b16-4b85-9a72-5f1b9d9e0d74] Going to try to terminate instance {{(pid=123566) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 04 18:20:08.128622 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-9c139340-c7f3-440c-8cc6-a7eb4e6bc23f tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "DELETE /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74" status: 204 len: 0 microversion: 2.1 time: 0.425763 Feb 04 18:20:08.129134 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 664/1319] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Feb 4 18:20:07 2022] DELETE /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 04 18:20:08.138029 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-97febd9f-4492-4edf-ac24-aee8123dccda tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:20:08.138855 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-97febd9f-4492-4edf-ac24-aee8123dccda tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: 89345003-9b16-4b85-9a72-5f1b9d9e0d74] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:20:08.145561 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-97febd9f-4492-4edf-ac24-aee8123dccda tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:08.145942 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-97febd9f-4492-4edf-ac24-aee8123dccda tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:08.146768 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-97febd9f-4492-4edf-ac24-aee8123dccda tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:08.147417 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-97febd9f-4492-4edf-ac24-aee8123dccda tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:08.305373 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-97febd9f-4492-4edf-ac24-aee8123dccda tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:20:08.312973 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-97febd9f-4492-4edf-ac24-aee8123dccda tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74" status: 200 len: 1579 microversion: 2.1 time: 0.179367 Feb 04 18:20:08.314328 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 656/1320] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:20:08 2022] GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74 => generated 1579 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:20:09.331288 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-8de61675-8a4e-4cab-b3b2-0074e3e090ba tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:20:09.331974 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-8de61675-8a4e-4cab-b3b2-0074e3e090ba tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: 89345003-9b16-4b85-9a72-5f1b9d9e0d74] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:20:09.338596 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8de61675-8a4e-4cab-b3b2-0074e3e090ba tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:09.339041 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8de61675-8a4e-4cab-b3b2-0074e3e090ba tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:09.339815 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8de61675-8a4e-4cab-b3b2-0074e3e090ba tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:09.340249 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-8de61675-8a4e-4cab-b3b2-0074e3e090ba tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:09.478839 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-8de61675-8a4e-4cab-b3b2-0074e3e090ba tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:20:09.487126 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-8de61675-8a4e-4cab-b3b2-0074e3e090ba tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74" status: 200 len: 1460 microversion: 2.1 time: 0.159814 Feb 04 18:20:09.487713 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 665/1321] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:20:09 2022] GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74 => generated 1460 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:20:10.504007 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-de0b95e0-af0e-477e-a37a-8d5111de031d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:20:10.505545 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-de0b95e0-af0e-477e-a37a-8d5111de031d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: 89345003-9b16-4b85-9a72-5f1b9d9e0d74] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:20:10.511819 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-de0b95e0-af0e-477e-a37a-8d5111de031d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:10.512274 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-de0b95e0-af0e-477e-a37a-8d5111de031d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:10.513066 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-de0b95e0-af0e-477e-a37a-8d5111de031d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:10.514103 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-de0b95e0-af0e-477e-a37a-8d5111de031d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:10.519958 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO oslo.messaging._drivers.impl_rabbit [-] [21547354-8e01-493d-8955-3cf44af18d84] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 36554. Feb 04 18:20:10.582218 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-de0b95e0-af0e-477e-a37a-8d5111de031d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:20:10.590984 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-de0b95e0-af0e-477e-a37a-8d5111de031d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74" status: 200 len: 1393 microversion: 2.1 time: 0.090633 Feb 04 18:20:10.591667 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 657/1322] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:20:10 2022] GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74 => generated 1393 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:20:10.595740 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-15ab5bf9-5d5e-414e-95d0-ca7b0955a0ad req-a8d3b262-0563-4578-b093-990ecb7fd9b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89345003-9b16-4b85-9a72-5f1b9d9e0d74", "name": "network-vif-deleted", "tag": "f0303691-ee1c-4cbd-b2e6-c1386c0a4d63"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:20:10.597356 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:20:10.597356 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:20:10.606057 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-15ab5bf9-5d5e-414e-95d0-ca7b0955a0ad req-a8d3b262-0563-4578-b093-990ecb7fd9b4 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:10.609089 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-15ab5bf9-5d5e-414e-95d0-ca7b0955a0ad req-a8d3b262-0563-4578-b093-990ecb7fd9b4 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:10.617971 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-15ab5bf9-5d5e-414e-95d0-ca7b0955a0ad req-a8d3b262-0563-4578-b093-990ecb7fd9b4 service nova] Creating event network-vif-deleted:f0303691-ee1c-4cbd-b2e6-c1386c0a4d63 for instance 89345003-9b16-4b85-9a72-5f1b9d9e0d74 on hv-cinder-82276 Feb 04 18:20:10.623631 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-15ab5bf9-5d5e-414e-95d0-ca7b0955a0ad req-a8d3b262-0563-4578-b093-990ecb7fd9b4 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031002 Feb 04 18:20:10.624217 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 666/1323] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:20:11.608547 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-e5da050c-c3a5-469e-b331-40320ec8c215 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:20:11.609152 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-e5da050c-c3a5-469e-b331-40320ec8c215 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: 89345003-9b16-4b85-9a72-5f1b9d9e0d74] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:20:11.615361 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e5da050c-c3a5-469e-b331-40320ec8c215 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:11.615806 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e5da050c-c3a5-469e-b331-40320ec8c215 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:11.616576 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e5da050c-c3a5-469e-b331-40320ec8c215 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:11.617010 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e5da050c-c3a5-469e-b331-40320ec8c215 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:11.650571 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e5da050c-c3a5-469e-b331-40320ec8c215 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:11.651354 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-e5da050c-c3a5-469e-b331-40320ec8c215 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:11.652149 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.objects.instance [None req-e5da050c-c3a5-469e-b331-40320ec8c215 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lazy-loading 'fault' on Instance uuid 89345003-9b16-4b85-9a72-5f1b9d9e0d74 {{(pid=123567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:20:11.696229 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-e5da050c-c3a5-469e-b331-40320ec8c215 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:20:11.704229 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-e5da050c-c3a5-469e-b331-40320ec8c215 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74" status: 200 len: 1231 microversion: 2.1 time: 0.099240 Feb 04 18:20:11.704831 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 658/1324] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:20:11 2022] GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74 => generated 1231 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:20:12.725390 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-66246466-0735-48c3-94b6-4e2a24e221c7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:20:12.726151 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-66246466-0735-48c3-94b6-4e2a24e221c7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: 89345003-9b16-4b85-9a72-5f1b9d9e0d74] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:20:12.733488 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-66246466-0735-48c3-94b6-4e2a24e221c7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:12.733933 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-66246466-0735-48c3-94b6-4e2a24e221c7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:12.734779 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-66246466-0735-48c3-94b6-4e2a24e221c7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:12.735213 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-66246466-0735-48c3-94b6-4e2a24e221c7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:12.751453 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-66246466-0735-48c3-94b6-4e2a24e221c7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] HTTP exception thrown: Instance 89345003-9b16-4b85-9a72-5f1b9d9e0d74 could not be found. Feb 04 18:20:12.752174 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-66246466-0735-48c3-94b6-4e2a24e221c7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Returning 404 to user: Instance 89345003-9b16-4b85-9a72-5f1b9d9e0d74 could not be found. {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:20:12.753062 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-66246466-0735-48c3-94b6-4e2a24e221c7 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74" status: 404 len: 111 microversion: 2.1 time: 0.032755 Feb 04 18:20:12.753751 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 667/1325] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:20:12 2022] GET /compute/v2.1/servers/89345003-9b16-4b85-9a72-5f1b9d9e0d74 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:20:16.279753 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-36304b98-d2fa-4a61-8d1c-3c9afb386a68 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:20:16.280552 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [req-2dba519c-faab-4f46-b8ee-32c006524d69 req-b0307355-1204-44b6-a667-c7acebd5d5b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb8c372c-53a6-4aec-8c97-08c8af67c775", "tag": "98179b91-ea4a-4986-9a47-3e8973f618d3"}]} {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:20:16.281313 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-36304b98-d2fa-4a61-8d1c-3c9afb386a68 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: bb8c372c-53a6-4aec-8c97-08c8af67c775] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:20:16.282136 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:20:16.282136 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: warnings.warn(msg) Feb 04 18:20:16.291572 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-2dba519c-faab-4f46-b8ee-32c006524d69 req-b0307355-1204-44b6-a667-c7acebd5d5b6 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:16.292201 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [req-2dba519c-faab-4f46-b8ee-32c006524d69 req-b0307355-1204-44b6-a667-c7acebd5d5b6 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:16.293654 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-36304b98-d2fa-4a61-8d1c-3c9afb386a68 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:16.295148 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-36304b98-d2fa-4a61-8d1c-3c9afb386a68 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:16.296768 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-36304b98-d2fa-4a61-8d1c-3c9afb386a68 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:16.298177 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-36304b98-d2fa-4a61-8d1c-3c9afb386a68 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:16.307439 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.compute.server_external_events [req-2dba519c-faab-4f46-b8ee-32c006524d69 req-b0307355-1204-44b6-a667-c7acebd5d5b6 service nova] Creating event network-changed:98179b91-ea4a-4986-9a47-3e8973f618d3 for instance bb8c372c-53a6-4aec-8c97-08c8af67c775 on hv-cinder-82276 Feb 04 18:20:16.314389 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [req-2dba519c-faab-4f46-b8ee-32c006524d69 req-b0307355-1204-44b6-a667-c7acebd5d5b6 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038590 Feb 04 18:20:16.315510 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 668/1326] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:20:16.335152 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-36304b98-d2fa-4a61-8d1c-3c9afb386a68 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: bb8c372c-53a6-4aec-8c97-08c8af67c775] Going to try to terminate instance {{(pid=123567) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 04 18:20:16.674615 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-36304b98-d2fa-4a61-8d1c-3c9afb386a68 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "DELETE /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775" status: 204 len: 0 microversion: 2.1 time: 0.403394 Feb 04 18:20:16.678298 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 659/1327] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Feb 4 18:20:16 2022] DELETE /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 04 18:20:16.687991 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-29f36b30-3d04-40c5-984a-fe183c03c807 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:20:16.689142 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-29f36b30-3d04-40c5-984a-fe183c03c807 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: bb8c372c-53a6-4aec-8c97-08c8af67c775] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:20:16.699790 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-29f36b30-3d04-40c5-984a-fe183c03c807 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:16.700520 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-29f36b30-3d04-40c5-984a-fe183c03c807 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:16.702706 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-29f36b30-3d04-40c5-984a-fe183c03c807 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:16.703419 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-29f36b30-3d04-40c5-984a-fe183c03c807 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:16.868417 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-29f36b30-3d04-40c5-984a-fe183c03c807 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:20:16.878081 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-29f36b30-3d04-40c5-984a-fe183c03c807 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775" status: 200 len: 1577 microversion: 2.1 time: 0.197400 Feb 04 18:20:16.878611 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 669/1328] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:20:16 2022] GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775 => generated 1577 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:20:17.902257 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-acf161ca-9278-4980-9caa-b2d487913a9c tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:20:17.902921 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-acf161ca-9278-4980-9caa-b2d487913a9c tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: bb8c372c-53a6-4aec-8c97-08c8af67c775] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:20:17.910114 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-acf161ca-9278-4980-9caa-b2d487913a9c tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:17.910611 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-acf161ca-9278-4980-9caa-b2d487913a9c tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:17.911406 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-acf161ca-9278-4980-9caa-b2d487913a9c tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:17.911846 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-acf161ca-9278-4980-9caa-b2d487913a9c tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:18.083369 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-acf161ca-9278-4980-9caa-b2d487913a9c tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:20:18.097163 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-acf161ca-9278-4980-9caa-b2d487913a9c tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775" status: 200 len: 1459 microversion: 2.1 time: 0.198642 Feb 04 18:20:18.098462 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 660/1329] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:20:17 2022] GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775 => generated 1459 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 04 18:20:19.132989 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-40d7e3e0-d130-4adc-89d4-601b9c4b675d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:20:19.133906 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-40d7e3e0-d130-4adc-89d4-601b9c4b675d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: bb8c372c-53a6-4aec-8c97-08c8af67c775] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:20:19.143976 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-40d7e3e0-d130-4adc-89d4-601b9c4b675d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:19.144441 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-40d7e3e0-d130-4adc-89d4-601b9c4b675d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:19.145262 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-40d7e3e0-d130-4adc-89d4-601b9c4b675d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:19.145715 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-40d7e3e0-d130-4adc-89d4-601b9c4b675d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:19.188672 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [req-7ae6d7f4-3109-4b1f-831b-5f0d18d31009 req-621b6e96-c0ea-4be1-aeb3-003cdd6c3e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8c372c-53a6-4aec-8c97-08c8af67c775", "name": "network-vif-deleted", "tag": "98179b91-ea4a-4986-9a47-3e8973f618d3"}]} {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 04 18:20:19.190620 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 04 18:20:19.190620 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: warnings.warn(msg) Feb 04 18:20:19.198252 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-7ae6d7f4-3109-4b1f-831b-5f0d18d31009 req-621b6e96-c0ea-4be1-aeb3-003cdd6c3e87 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:19.198735 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [req-7ae6d7f4-3109-4b1f-831b-5f0d18d31009 req-621b6e96-c0ea-4be1-aeb3-003cdd6c3e87 service nova] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:19.212807 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.compute.server_external_events [req-7ae6d7f4-3109-4b1f-831b-5f0d18d31009 req-621b6e96-c0ea-4be1-aeb3-003cdd6c3e87 service nova] Creating event network-vif-deleted:98179b91-ea4a-4986-9a47-3e8973f618d3 for instance bb8c372c-53a6-4aec-8c97-08c8af67c775 on hv-cinder-82276 Feb 04 18:20:19.218464 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [req-7ae6d7f4-3109-4b1f-831b-5f0d18d31009 req-621b6e96-c0ea-4be1-aeb3-003cdd6c3e87 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034061 Feb 04 18:20:19.219658 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 661/1330] 10.222.0.98 () {64 vars in 1317 bytes} [Fri Feb 4 18:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 04 18:20:19.221994 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.policy [None req-40d7e3e0-d130-4adc-89d4-601b9c4b675d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123566) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:20:19.230111 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-40d7e3e0-d130-4adc-89d4-601b9c4b675d tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775" status: 200 len: 1392 microversion: 2.1 time: 0.107499 Feb 04 18:20:19.230727 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 670/1331] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:20:19 2022] GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775 => generated 1392 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:20:20.249326 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-0d37078e-4fa6-4557-b95b-cb497d6bc7c8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:20:20.249947 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-0d37078e-4fa6-4557-b95b-cb497d6bc7c8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: bb8c372c-53a6-4aec-8c97-08c8af67c775] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:20:20.256595 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0d37078e-4fa6-4557-b95b-cb497d6bc7c8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:20.257019 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0d37078e-4fa6-4557-b95b-cb497d6bc7c8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:20.257829 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0d37078e-4fa6-4557-b95b-cb497d6bc7c8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:20.258273 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0d37078e-4fa6-4557-b95b-cb497d6bc7c8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:20.296556 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0d37078e-4fa6-4557-b95b-cb497d6bc7c8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:20.296991 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-0d37078e-4fa6-4557-b95b-cb497d6bc7c8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:20.297465 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.objects.instance [None req-0d37078e-4fa6-4557-b95b-cb497d6bc7c8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lazy-loading 'fault' on Instance uuid bb8c372c-53a6-4aec-8c97-08c8af67c775 {{(pid=123567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 04 18:20:20.357736 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.policy [None req-0d37078e-4fa6-4557-b95b-cb497d6bc7c8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '508cd118fbdd432491f2e778e789473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ff016321049ceb841522b8fe2c27a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123567) authorize /opt/stack/nova/nova/policy.py:199}} Feb 04 18:20:20.365684 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-0d37078e-4fa6-4557-b95b-cb497d6bc7c8 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775" status: 200 len: 1231 microversion: 2.1 time: 0.121568 Feb 04 18:20:20.366278 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 662/1332] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:20:20 2022] GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775 => generated 1231 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 04 18:20:21.385451 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-9c8f3937-d46f-4844-8bf5-26dedfa9df31 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:20:21.386547 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-9c8f3937-d46f-4844-8bf5-26dedfa9df31 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: bb8c372c-53a6-4aec-8c97-08c8af67c775] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:20:21.393828 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9c8f3937-d46f-4844-8bf5-26dedfa9df31 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:21.394452 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9c8f3937-d46f-4844-8bf5-26dedfa9df31 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:21.395399 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9c8f3937-d46f-4844-8bf5-26dedfa9df31 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:21.395954 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-9c8f3937-d46f-4844-8bf5-26dedfa9df31 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:21.411960 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-9c8f3937-d46f-4844-8bf5-26dedfa9df31 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] HTTP exception thrown: Instance bb8c372c-53a6-4aec-8c97-08c8af67c775 could not be found. Feb 04 18:20:21.412468 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-9c8f3937-d46f-4844-8bf5-26dedfa9df31 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Returning 404 to user: Instance bb8c372c-53a6-4aec-8c97-08c8af67c775 could not be found. {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:20:21.413315 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-9c8f3937-d46f-4844-8bf5-26dedfa9df31 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775" status: 404 len: 111 microversion: 2.1 time: 0.031768 Feb 04 18:20:21.413887 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 671/1333] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:20:21 2022] GET /compute/v2.1/servers/bb8c372c-53a6-4aec-8c97-08c8af67c775 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 04 18:20:22.213697 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-27f7d691-41c3-4bb5-b983-8cd945df84fb tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:20:22.214291 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.compute.api [None req-27f7d691-41c3-4bb5-b983-8cd945df84fb tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123567) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:20:22.221209 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-27f7d691-41c3-4bb5-b983-8cd945df84fb tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:22.221661 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-27f7d691-41c3-4bb5-b983-8cd945df84fb tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:22.222465 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-27f7d691-41c3-4bb5-b983-8cd945df84fb tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:22.222910 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG oslo_concurrency.lockutils [None req-27f7d691-41c3-4bb5-b983-8cd945df84fb tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:22.236562 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.wsgi [None req-27f7d691-41c3-4bb5-b983-8cd945df84fb tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] HTTP exception thrown: Instance fe11be94-d623-43fe-9319-e6ea69528e71 could not be found. Feb 04 18:20:22.237196 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-27f7d691-41c3-4bb5-b983-8cd945df84fb tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Returning 404 to user: Instance fe11be94-d623-43fe-9319-e6ea69528e71 could not be found. {{(pid=123567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:20:22.238022 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-27f7d691-41c3-4bb5-b983-8cd945df84fb tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "DELETE /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 404 len: 111 microversion: 2.1 time: 0.028067 Feb 04 18:20:22.238616 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 663/1334] 10.222.0.98 () {58 vars in 1238 bytes} [Fri Feb 4 18:20:22 2022] DELETE /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:20:22.246523 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-1c0c12a7-b1dc-402b-b2d3-582b164db20a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '>' {{(pid=123566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:20:22.247141 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.compute.api [None req-1c0c12a7-b1dc-402b-b2d3-582b164db20a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] [instance: fe11be94-d623-43fe-9319-e6ea69528e71] Fetching instance by UUID {{(pid=123566) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 04 18:20:22.253174 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1c0c12a7-b1dc-402b-b2d3-582b164db20a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:22.253630 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1c0c12a7-b1dc-402b-b2d3-582b164db20a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:22.254452 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1c0c12a7-b1dc-402b-b2d3-582b164db20a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 04 18:20:22.254882 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG oslo_concurrency.lockutils [None req-1c0c12a7-b1dc-402b-b2d3-582b164db20a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Lock "97b60c31-2cf9-4488-ba33-21689903d427" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 04 18:20:22.269441 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.wsgi [None req-1c0c12a7-b1dc-402b-b2d3-582b164db20a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] HTTP exception thrown: Instance fe11be94-d623-43fe-9319-e6ea69528e71 could not be found. Feb 04 18:20:22.270040 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: DEBUG nova.api.openstack.wsgi [None req-1c0c12a7-b1dc-402b-b2d3-582b164db20a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Returning 404 to user: Instance fe11be94-d623-43fe-9319-e6ea69528e71 could not be found. {{(pid=123566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 04 18:20:22.270920 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO nova.api.openstack.requestlog [None req-1c0c12a7-b1dc-402b-b2d3-582b164db20a tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71" status: 404 len: 111 microversion: 2.1 time: 0.028106 Feb 04 18:20:22.271486 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: [pid: 123566|app: 0|req: 672/1335] 10.222.0.98 () {58 vars in 1235 bytes} [Fri Feb 4 18:20:22 2022] GET /compute/v2.1/servers/fe11be94-d623-43fe-9319-e6ea69528e71 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 04 18:20:23.772880 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: DEBUG nova.api.openstack.wsgi [None req-63538f29-230f-4463-b9ed-bacadbb03243 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] Calling method '.version_select at 0x7fe8cc9de1f0>' {{(pid=123567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 04 18:20:23.866187 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO nova.api.openstack.requestlog [None req-63538f29-230f-4463-b9ed-bacadbb03243 tempest-TestVolumeBootPattern-2124800303 tempest-TestVolumeBootPattern-2124800303-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1196483484" status: 202 len: 0 microversion: 2.1 time: 0.097084 Feb 04 18:20:23.867028 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: [pid: 123567|app: 0|req: 664/1336] 10.222.0.98 () {58 vars in 1262 bytes} [Fri Feb 4 18:20:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1196483484 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 04 18:20:46.758627 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 04 18:20:46.759328 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: Fri Feb 4 18:20:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 04 18:20:53.594024 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 04 18:20:53.594693 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: Fri Feb 4 18:20:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 04 18:22:25.816959 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 04 18:22:25.817752 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: Fri Feb 4 18:22:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 04 18:23:07.893413 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 04 18:23:07.894111 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: Fri Feb 4 18:23:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 04 18:24:06.767231 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 04 18:24:06.768025 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: Fri Feb 4 18:24:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 04 18:24:13.602915 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 04 18:24:13.603560 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: Fri Feb 4 18:24:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 04 18:25:45.825239 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 04 18:25:45.826002 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: Fri Feb 4 18:25:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 04 18:26:03.058821 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 04 18:26:03.059413 dv-cinder-822768-3-iscsi devstack@n-api.service[123567]: Fri Feb 4 18:26:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 04 18:26:06.020300 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 04 18:26:06.020300 dv-cinder-822768-3-iscsi devstack@n-api.service[123566]: Fri Feb 4 18:26:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!